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A set of well-defined and quantifiably justified Measures of 
Performance (MOPs) is required for the armament and fuel tasks of a 
Carrier Battle Group (CVBG) as described in the Universal Naval Task 
List (UNTL). Well-defined MOPs are required because the current 
UNTL contains MOPs that are not relevant for the Battle Group 
Commander to effectively evaluate task performance at the CVBG 
level. These MOPS are incorporated in the CVBG‘s training plan and 
provide the Battle Group Commander a method to evaluate the CVBG’s 
level of ability to perform the necessary tasks. This thesis 
proposes 37 MOPs and an application to subjectively evaluate the 
MOPs to determine which ones are well defined. The application also 
objectively. evaluates Jehe Ors “co determine iow s. vel Paesene 
collectively measure task performance. The proposed MOPS are 
derived from the task descriptions and objectives found in the UNTL. 
They are subjectively scrutinized using the twelve criteria required 
by the UNTL and objectively evaluated uSing correlation analysis. A 
Simulation is developed for each task to provide the data for the 
objective analysis. The results indicate that 25 of the 37 proposed 
MOP’s meet the required criteria of being well defined and useful in 
measuring task performance. Based upon the developed application, 
it is recommended that the Naval Doctrine Command consider the 25 


MOPs for inclusion into its revised UNTL. 
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DISCLAIMER 


The reader is cautioned that the computer program (simulation) 
developed in this research may not have been exercised for all cases of 
interest. While every effort has been made, within the time available, 
to ensure that the program is free of computational and logic errors, 
it cannot be considered validated. Any application of this program 


Without additional verification is at the risk of the user. 
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EXECUTIVE SUMMARY 


The U.S. Navy intends to improve the way its forces train for 
combat operations. A new approach to training has been adopted that 
uses the Universal Naval Task List (UNTL) to identify the tasks, 
conditions, and standards needed to develop Mission Essential Tasks 
(METS) . METs are tasks deemed essential to accomplish the mission. 
The UNTL serves as a basis for process level modeling of naval task 
performance. 

The UNTL is developed by Naval Doctrine Command and consists of 
tasks, conditions, and standards needed to perform in all areas of 
combat operations. When assigned a combat mission, a Battle Group 
Commander (BGCDR) uses the UNTL to determine (1) the tasks required of 
the Carrier Battle Group (CVBG) to execute the mission, (2) the 
conditions of the operating environment that may affect task 
performance, and (3) the standards required to evaluate how well the 
tasks are performed under the selected conditions. 

Naval Doctrine Command is revising the UNTL to determine the 
Standards required to assess how well CVBG tasks are performed. Those 
Standards consist of measures of performance (MOP) and criteria used to 
assess the extent to which the standards are achieved. MOPs provide a 
dimension, capacity, or quantity description to a task to indicate how 
well a task is performed. The criteria are the acceptable levels of 
the MOP set by the BGCDR. There is a major problem, however: the 
CVBG’s Armament and Fuel MOPs listed in the UNTL are ill defined. The 
CVBG is a tactical level organization, and the MOPs currently listed in 
the UNTL are focused on the strategic level. 

The. UNTL is divided into four levels of combat. Each level is 


divided into six mission objective categories. One of those categories 


XV 


is Perform Logistics and Combat Service Support, which is further 
divided into thirteen sub-categories. The UNTL lists tasks and MOPs 
for each sub-category of every mission objective category. This thesis 
focuses on two of the thirteen sub-categories, namely, Armament and 
Fuel, because ordnance and fuel are the two most critical support 
elements in sustaining a CVBG. The present work determines (1) what 
MOPs can be well-defined for each task within the Armament and Fuel 
sub-categories, and (2) how well those MOPs measure task performance. 

A five-step application is developed to define MOPs and determine 
how well they measure task performance. The application analyzes the 
components of the task to determine the specific measurements needed to 
evaluate the extent to which an operation’s performance achieves 
criterion performance. Those specific measurements are quantifiable 
variables that comprise MOPs. 

A qualitative analysis is conducted to determine if the MOPS can 
be defined for each task. The analysis uses twelve criteria listed in 
the UNTL to provide standards from which to conclude the validity of a 
well-defined MOP. These criteria are dichotomous; either a “yes” or 
“no” response. The resulting analysis provides well-defined MOPs for 
each Armament and Fuel task. 

Each task is simulated to obtain values for the MOPs and MOEs. 
One analysis evaluates the MOPs and the task’s defined measures of 
effectiveness (MOE) to examine how well the MOPs measure task 
performance. The values obtained for the MOPs are then compared with 
the values of their respective task’s MOE to determine the extent to 
which the variables correlate. A high correlation suggests that an MOP 
1s a strong indicator of task performance. 

The results of the first analysis indicate that 37 MOPs (thirteen 


MOPs for the Armament tasks and twenty-four MOPs for the Fuel tasks) 
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are well defined, but only 25 meet the standards defined for the second 
analysis. Based on the application developed here, it 1S recommended 
that Naval Doctrine Command consider these 25 MOPs for inclusion into 
its revised UNTL. These MOPs can then be used to evaluate performance 


of CVBG armament and fuel task performance. 
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IG INTRODUCTION 


A. OVERVIEW 

The U.S. Navy along with the joint military community is working 
to improve the way the U.S. military forces prepare and train for 
combat operations. A new systematic approach to military combat 
training 1s evolving which uses the Universal Naval Task List (UNTL) 
and the Navy Mission Essential Task List (NMETL) concept to define 
mission tasks and their expected performance. 

The UNTL is a single source document used by the Navy, Marine 
Corps, and Coast Guard to develop a Mission Essential Task List (METL). 
Mission Essential Tasks (METs) are tasks selected by the Battle Group 
Commander (BGCDR) which are taken from the UNTL and deemed essential to 
mission accomplishment. The NMETL is a list of the Navy’s essential 
tasks. One of the keys to this new training approach is the concept of 
training to a list of METs. These concepts and those of the UNTL and 
NMETL are discussed later in Chapter II. 

As head of the Carrier Battle Group (CVBG), the BGCDR uses the 
NMETL development process as a framework to quantify the level of work 
and the scope of effort needed for the CVBG to achieve specific mission 
objectives. As applied to CVBG training, the UNTL provides the common 
language that the BGCDR can use to document the command warfighting 
requirements as mission essential tasks. 

The UNTL is divided into numerous categories and provides the 


task description, conditions, and standards needed to define a mission 


essential task. The standards are comprised of measures and criteria. 
A measure, also called a measure of performance (MOP), is a dimension, 
capacity, or quantity description related to a task. A criterion 1s a 


quantitative value on which a judgment or decision is based. This 


thesis proposes and validates MOPs for the CVBG in two logistical 


areas: armament and fuel. 


S PROBLEM STATEMENT 

One of the UNTL categories, the Navy tactical logistics category, 
or NTA 4 Perform Logistics and Combat Service Support, lists Armament 
and Fuel MOPs that are ill defined for the CVBG. Well-defined MOPs 
enable the BGCDR to develop mission essential tasks that effectively 
evaluate Armament and Fuel logistic task performance in CVBG exercises. 
This thesis addresses two questions. First, "What measures of 
performance can be well-defined for each task within the ordnance and 
fuel sub-categories of the NTA 4 Perform Logistics and Combat Service 
Support tactical level hierarchical listing?" Second, “How well do 


those measures of performance measure task performance?” 


Cx DESCRIPTION OF THE METHODOLOGY 

A method is described in Chapter IV that derives variables that 
measure each task process. Those derivations are based upon the 
description of each task and the process involved to complete the task. 
The variables could be time, ratios. quantities, or some other 
quantifiable description required to measure the task’s performance. 
Measures of performance for each task are then determined subjectively 
from those variables by validating them against twelve criteria that 
are defined in Chapter IV. This step answers the first question, “What 
MOPs can be well-defined for each task within the ordnance and fuel 
sub-categories?” 

To determine how well the MOPS measure task performance, a 
quantitative analysis is conducted in Chapter V between the MOPs and 


the given:measures of effectiveness (MOE) related to each task. A 


tO 


spreadsheet based simulation model is designed for each task to obtain 
the data necessary to conduct the quantitative analysis. Correlation 
analysis determines the statistical relationship between an MOP and its 
MOE. This step answers the second question, “How well do the MOPs 


measure task performance?” 


D. ORGANIZATION OF THESIS 
This thesis is organized into six chapters. Chapter I provides 
an overview of the problem. Chapter II gives a description of the UNTL 


and the NMETL development process. Chapter III gives a description of 
CVBG ordnance and fuel logistic tasks used in the UNTL. Chapter IV 
describes the models used to obtain the CVBG fuel and ordnance 
measures. Chapter V provides the results of analysis. Chapter VI 
provides conclusions, recommendations, and areas for further study of 


the subject area. 
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Et: BACKGROUND 


This chapter describes the general development of the Navy 
Mission Essential Task List (NMETL), and specifically for the armament 


and fuel sub-categories of the logistic category in the tactical level 


of combat within the UNTL. The MOEs and MOPs are provided for each 
task. 
A. THE NMETL DEVELOPMENT PROCESS 


The Navy is developing a new training strategy that incorporates 


the UNTL into the process of defining CVBG tasks based upon mission 


requirements. Those CVBG tasks are used by BGCDRs to develop Naval 
Mission Essential Task Lists (NMETL), which, in turn, are used to 
define priorities in accomplishing the mission. The NMETL is the 


Navy's list of METs that supports CVBG training by providing a list of 
the BGCDR’s prioritized requirements based upon assigned mission 
objectives. Figure 2.1 represents the flow of the NMETL development 


process taken from reference [1]. 


Plans/ 
Orders 


Assigned Naval 
Missions Doctrine 


Mission Analysis 





Figure 2.1 NMETL Development Process. 


The NMETL development process iS explained in reference [2] and 
1s divided into three steps. 

e Step 1. Identify the Mission Essential Task (MET). 

e Step 2. Describe the Conditions. 

e Step 3. Establish the Standards. 

These steps guide the BGCDR through the analysis of assigned 


missions to arrive at a set of mission-based required capabilities. 


These required capabilities are expressed in terms of: (1) the tasks to 
be performed; (2) the conditions in which those tasks are to be 


performed; and (3) the standards to which that performance is achieved. 


The following definitions apply: 


e Tasks. Events that enable the mission to be accomplished. 
e Conditions. Variables of the operating environment that may 


affect task performance. 
e Standards. Measures and criteria. 
¢ Measures provide a dimension, capacity, or quantity 
description to a task. “Measure” is used interchangeably 
with Measure of Performance (MOP). 
¢ Criteria describe the acceptable levels of performance. 
Determining valid MOPs for the standards mentioned above is the 
focus of this thesis. In Step 1, the BGCDR examines the mission and 
applies the UNTL, doctrine, plans, and orders to identify the CVBG's 
naval METs; for example, a CVBG mission may require the UNTL task 
Establish Water Space Management. In Step 2, the BGCDR describes the 
conditions in which the tasks are to be performed; for example, the 
conditions may be in the Ocean Waters-Atlantic, under High Shipping 
Presence, and with Full Maritime Superiority. In Step 3, the Beer 


establishes standards for the NMETL based upon mission requirements; 


for example, a standard may be the Zero - Number of incidents of 


collision with underwater objects. 


Bs ORGANIZATION OF THE UNTL 

The UNTL lists all the combat associated tasks, conditions, and 
standards that are used in the NMETL development process described 
above. It is divided into four levels of combat: Strategic Theater 
(ST), Strategic National (SN), Operational (OP), and Tactical (NTA). 


These four levels are sub-divided into six mission objective categories 


that are depicted in figure 2.2. [Ref.1] 


various sub-categories. 


Combat Service Support. 
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Figure 2.2 


UNTL Hierarchical Listing. 
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These six mission objective categories are further divided into 


and NTA 4.2 Fuel. 


This thesis focuses upon two sub-categories of 
the mission objective category, namely, NTA 4 Perform Logistics and 


Those two sub-categories are NTA 4.1 Armament 


The sub-categories are asSigned specific tasks that are 
determined by Naval Doctrine Command. There are three tasks in the 
Armament sub-category and five tasks in the Fuel sub-category. These 
tasks are listed below: 

e NTA 4.1L Armament; 

@ NTA 4.1.1 Schedule/Coordinate Armament of Task Force; 
@ NTA 4.1.2 Provide Munitions Management; 
¢ NTA 4.1.3 Provide Munitions, Pyrotechnics, and Specialty 
Items; 
e NTA 4.2 Fuel; 
@ NTA 4.2.1 Conduct Fuel Management; 
@ NTA 4.2.2 Schedule/Coordinate Refueling; 
@ NTA 4.2.3 Conduct Aerial Refueling; 
@ NTA 4.2.4 Move Bulk Fuel; 


@ NTA 4.2.5 Provide Packaged Petroleum Products. 


The UNTL describes each task of the Armament and Fuel sub- 
categories. The objectives of each task are subjectively derived from 
the task description. Deriving the objectives helps determine what 
aspects of the task process are required to be measured to develop 
MOPs. For example, the description for the UNTL task NTA 4.2.3 Conduct 
Aerial Refueling 1s to “schedule and conduct air to air refueling with 
refueling tanker aircraft”. [Ref.1] The objectives are to properly 
schedule and conduct the operation. To determine how well that task is 
accomplished, the process of scheduling and conducting aerial refueling 
must be measured. 

In addition to these task descriptions and objectives, the author 


derives MOEs from the various references to amplify the descriptions 


and help identify the ultimate purpose of each task. MOEs describe how 
effective the CVBG is in combat by accomplishing a task. From the 
description of the task process, objectives, and MOEs, MOPs are 
developed. Before listing the derived MOEs and the developed MOPs,'a 


discussion of MOPs and MOEs is first required. 


©; DISCUSSION OF MEASURES OF PERFORMANCE AND EFFECTIVENESS 

Combining the definitions of “measure” and “performance” from 
reference [3], a measure of performance is “a basis for evaluation or 
comparison on the way in which someone or something functions.” To 
apply that definition to a CVBG accomplishing its mission, this thesis 
defines “measure of performance” as a metric that provides a way for a 
BGCDR to describe how well the CVBG organization performs a task under 
a specific set of conditions for a specific mission. 

MOPs are used to determine how well a task is performed, to make 
an existing system work better, and to design and prepare to operate 
future systems so that they will work better. [Ref.4] Generally, a 
single MOP is not sufficient to fully address the capabilities of CVBG 
task performance. Some MOPs may be more relevant, descriptive, and 
important than others for the specie ie Situation being addressed. 

The need to make the distinction between an MOP and MOE is 
required. MOPs answer the questions, “Did the CVBG perform the task it 
was supposed to do?” and “How well did the CVBG perform that task?” 
They describe how well the CVBG met its designed objective. MOES 
answer the question, “What is the military value of the CVBG?” They 
describe the capability of the CVBG to carry out a military task when 


called upon. [Ref.5] 


Ideally, the MOPs and MOEs should be closely linked to make them 
effective in measuring task performance. If a CVBG satisfies its MOPs, 
then it should have sufficient capability to carry out its tasks and 
Satisfy its MOEs. Conversely, i1f the CVBG satisfies its MOEs, it 
Should have sufficient inherent capability to satisfy its MOPs. is 
MOPS and MOES are poorly defined and not closely linked, then it is 
certainly conceivable that a CVBG could execute its assigned tasks very 
well (e.g., high MOPs) yet have very little military value (e.g., low 
MOEs) to itself or the entire combat force in winning a battle. [Ref.5] 
Therefore, MOPs and MOEsS must be well defined in order for them to 
properly serve their function as a measurement and evaluation tool. 

This thesis uses the term quantifiable variable that will be 
related to both MOPs and MOEs. Quantifiable variables are quantifiable 
descriptors of task performance given in terms of time, ratios, 
quantities, or some other measurable description. A single MOP may 
depend on one or several of these variables. 

For example, an MOP may be the percent of the needed fuel that 
was transferred and depends on the quantifiable variables of the rate 
of fuel transfer and the amount of fuel to transfer. Aggregating the 
variables into a single task descriptor forms the MOP. Figure 2-2 


shows the relationship between quantifiable variables, MOPs, and MOEs. 
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ARMAMENT AND FUEL TASK MOES AND MOPS 


The author proposes the following MOEs for the tasks: 


NTA 4.1.1 Schedule/Coordinate Armament of Task Force; 


©. WAS s 1s Dod 


@ NTA 4.1.1.2 
[Ref.6]; 


Time Off Station [Ref.6]; 


Percent of Maximum Capacity Experienced 


NTA 4.1.2 Provide Munitions Management; 


© Nie ee ee 
[Ref .6]; 


© NIA 4.2% 


Percent of Maximum Capacity Experienced 


mime *OLree@Station [Reimers |= 


NTA 4.1.3 Provide Munitions, Pyrotechnics, and Specialty 


Items; 


@ NTA 4.33352 
[Ref .6] ; 


© ANTAS42 1.32 


Percent of Maximum Capacity Experienced 


Time Off Station [Ref.6]; 


NTA 4.2.1 Conduct Fuel Management; 


© NTA 422.158 


@ NTA 4.2.1.2 
[Ref .6]; 


Time On Station Lost [Ref.8]; 


Percentlon Maximum Capacity Mxperl enced 


| 





and 


e NTA 4.2.2 Schedule/Coordinate Refueling; 
@° NTA 4.2.2.1 Time Off "Station [Ref .6]-; 


® NTA 4.2.2.2 Percent of Maximum Capacity Experienced 
[Ref .6] ; 


e NTA 4.2.3 Conduct Aerial Refueling; 


@ NTA 4.2.3.1 Number of Aircraft Available to Refuel 


[Ref .9]; 


@ NTA 4.2.3.2 Number of Aircraft that Could Not Refuel 


[Ref .9]; 
@ NTA 4.2.3.3 Time On Station {ker 10]; 
e® NTA 4.2.4 Move Bulk Fuel; 
@ NTA 4.2.4.1 Time Off Station [Ref.6]; 


@ NTA 4.2.4.2 Percent of Maximum Capacity Experienced 
[Ref .6]; 


e NTA 4.2.5 Provide Packaged Petroleum Products; 


@ NTA 4.2.5.1 Efficiency of Packaging [Ref.11]. 

These MOEsS are described in Chapter III, and the process of how 
they are derived is explained in Chapter IV, Section B. These MOEs 
have associated MOPs. These MOPs are used to define “how well” the 
task 1s completed. MOPs are a better measure of task performance when 
they are related well to their respective MOE. The MOE measures the 
effectiveness of the task’s results in combat. When MOPs and MOES are 
completed satisfactorily, the task’s utility towards accomplishing 
misSion objectives is high. 

Naval Doctrine Command is in the process of defining MOPs to 
include into the UNTL because the concept of using the UNTL for combat 
training 1s new. Because of this ongoing process, the author 
identified various MOPs based upon a task’s objectives and its 


associated MOEs. The relationship between an MOE with its respective 


MOPs is defined by the equations of the MOES and MOPs in Chapter IV. 


The following MOPs are recommended for each MOE: 
® “NTA 4,1.4;..1 Tame Off Station. 
@(metA 4.162212) .fime toscempiece the UNREP Evolution; 
@ NTA 4.1.1.1.2 Time from Request for Ordnance to Commencing 
UNREP ; 
e NTA 4.1.1.2 Percent of Maximum Capacity Experienced; 
@ NTA 4.1.1.2.1 Ratio of the Ordnance Available onboard 


Shuttle Ships to the CVBG Ordnance Requirements; 
@ NTA 4.1.1.2.2 Percent of the Needed Ordnance Transferred; 
e NTA 4.1.2.1 Percent of Maximum Capacity Experienced; 


@¢ NTA 4.1.2.1.1 Ratio of the Ordnance Available onboard 


Shuttle Ships to the CVBG Ordnance Requirements; 
@ NTA 4.1.2.1.2 Percent of the Needed Ordnance Transferred; 
® NTA 4521.2:2 Time Of£E Statwen. 
@ NTA 4.1.2.2.1 Time to Complete the UNREP Evolution; 
@ NEA: 4.132222) meetron Request for Ordnance to Commencing 
UNREP; 
e NTA 4.1.3.1 Percent of Maximum Capacity#@Experienced; 


@ NTA 4.1.3.1.1 Ratio of the Ordnance Available onboard the 


Shuttle Ships to the Combatant Ships Ordnance Requirements; 


@ NTA 4.1.3.1.2 Ratio of the Ordnance Available onboard the 


Shuttle Ships to the Station Ship Ordnance Requirements; 
@¢ NTA 4.1.3.1.3 Percent of the Needed Ordnance Transferred; 
@ > NEA 4) 1.3223 met OLeectacion: 


@ NTA 4.1.3.2.1 Time to Complete the UNREP Evolution; 
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¢ NTA 4.1.3.2.2 Time from Request for Ordnance to Commencing 
UNREP; 
e NTA 4.2.1.1 Time On Station Lost; 
® NTA 4.2.1.1.1 Percent of the Needed Fuel Quantity 
Correctly Identified; 
¢ NTA 4.2.1.1.2 Ratio of the Fuel Available onboard the 
Shuttle Ships to the CVBG Requirements; 
@¢ NTA 4.2.1.1.3 Percent of the Needed Fuel Transferred; 
e NTA 4.2.1.2 Percent of Maximum Capacity Experienced; 
@ NTA 4.2.1.2.1 Ratio of the Fuel Available onboard the 
Shuttle Ships to the CVBG Requirements; 
@ NTA 4.2.1.2.2 Percent of the Needed Fuel Transferred; 
e NTA 4.2.2.1 Time Off Station; 
@ NTA 4.2.2.1.1 Time from the Request for Fuel to Commencing 
the UNREP; 
@ NTA 4.2.2.1.2 Time to Complete the UNREP Evolution; 
e NTA 4.2.2.2 Percent of Maximum Capacity Experienced; 
@ NTA 4.2.2.2.1 Ratio of the Fuel Available onboard the 
Shuttle Ships to the CVBG Requirements; 
@ NTA 4.2.2.2.2 Percent of the Needed Fuel Transferred; 
e NTA 4.2.3.1 Number of Aircraft Could Have Refueled; 
@ NTA 4.2.3.1.1 Rate of Fuel Transfer per Tanker Actually 
Used; 
@ NTA 4:223-1.2 Time to reruel Al! combac Aicerae a, 


@ NTA 4.2.3.1.3 Ratio of Combat Aircraft per Tanker; 
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e NPA 4.2.9%2 Bamber of AlireérafercomldeNot Reftel; 
@ NTA 4.2.3.2.1 Rate of Fuel Transfer per Tanker Actually 
Used; 
@ NTAw4e2.3.2.2 Time to refuel All Combat Aircraft; 
@ NTA 4.2.3.2.3 Ratio of Combat Aircraft per Tanker; 
e NTA 4.2.3.3 Time On Station; 
@ NTA 4.2.3.3.1 Rate of Fuel Transfer Actually Used; 
@ NTA 4.2.3.3.2 Ratio of Combat Aircraft per Tanker; 
©, NTA+4. 2 41 Pome ert Station- 


@ NTA 4.2.4.1.1 Time from the Request for Fuel to Commencing 


the UNREP; 
@ NTA 4.2.4.1.2 Time to Complete the UNREP Evolution; 
e NTA 4.2.4.2 Percent of Maximum Capacity Experienced; 


@ NTA 4.2.4.2.1 Ratio of the Fuel Available onboard the 


Shuttle Ships to the Combatant Ship Requirements; 


@ NTA 4.2.4.2.2 Ratio of the Fuel Available onboard the 


Shuttle Ships to the Station Ship Requirements; 
@ NTA 4.2.4.2.3 Percent of the Needed Fuel Transferred; 
e NTA 4.2.5.1 Efficiency of Packaging; 
@ NTA 4.2.5.1.1 Percent of Packaged Products Damaged; 


@ NTA 4.2.5.1.1 Percent of Packaged Products Improperly 


Labeled; 


@ NTA 4.2.5.1.1 Percent of Packaged Products Found Unusable; 


The relationship between the MOES and MOPs are defined in the 
equations provided in Chapter IV. The quantitative analysis of this 


thesis captures how important these MOPs are to their respective MOEs. 


This analysis correlates an MOP and MOE’s range of values to determine 
the strength of their relationship. 

Figure A.1 of Appendix A illustrates the relationship among the 
Armament tasks, MOEs, and MOPs. Figure A.2 of Appendix A illustrates 
the relationship among the Fuel tasks, MOEs, and MOPs. The 
descriptions for each task and their associated MOEs are explained in 


the next chapter. 


Ey VARIABLES OF THE MOPS 

The measurable variables of a task process are the quantifiable 
variables. They contribute to MOPs. For each recommended MOP listed 
in Section D above, the author identifies some quantifiable variables 
that contribute to them. The variables are listed in Appendix B. 
Refer to Chapter IV, Sections A and B, as to how the variables are 


obtained. 


we VALIDATING THE MOPS 

This thesis provides recommended MOPs for each Armament and Fuel 
logistic task of the UNTL. To assess their usefulness in determining 
how well a task is accomplished, this thesis applies a qualitative and 
quantitative analysis to each MOP. The qualitative analysis consists 
of applying twelve criteria provided by the UNTL to each MOP. Those 
criteria set the standards for basing a subjective decision of whether 
the MOP is useful. The quantitative analysis consists of determining 
the correlation between an MOP and its MOE. By analyzing the 
correlation coefficient, a more formal determination of how well the 
MOP measures task performance is established. Explanations of the 


qualitative and quantitative analyses are described in Chapter IV. 
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III. CARRIER BATTLE GROUP ORDNANCE AND FUEL TASKS 


A. BACKGROUND 

The Navy's Carrier Battle Group (CVBG) is a combat formation of 
ships and aircraft that comprises a principal component of U.S. 
military power. The "standard" CVBG is one that can provide the 
initial crisis response mission from a rotationally deployed forward 


posture. A "standard" CVBG defined by reference [12] contains: 


e One Aircraft Carrier 

e One Carrier Air Wing 

e Six Surface Combatant Ships 

e Two Attack Submarines 

e One Multi-purpose Logistic Support Ship (e.g., station ship). 


The CVBG is able to conduct operations across the spectrum of 
warfare. It is a powerful asset because it is composed of balanced 
warfighting and peacekeeping capabilities required to meet the broad 
range of contingencies faced today. 

The U.S. Navy’s ability to project power across long ocean 
distances is bolstered by its ability to sustain itself at sea and 
assist land forces for prolonged periods mostly without land-based 
SuppOre. Sustainment of fuel and ordnance are the two most critical 
Support elements of this power projection. Embedded in the sustainment 
process is a logistics pipeline that stretches from the industrial base 
of the United States to the forward-deployed ships of war. The final 
Stages of these processes consist of the distribution of those assets 
to the ships. This is accomplished through either replenishment 
pierside or replenishment at sea. 

To properly execute the final stages, intensive training is 
required. Included in that training process is the execution of 


logistic tasks taken from the UNTL. Figure 2.1 on page 5 lists the 
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UNTL sub-categories of CVBG logistics that are crucial to these 
specific operations. Emphasizing the requirement to train in logistic 
tasks is one of the thirteen required CVBG tasks defined by the 


CNO. {Ref .12] 


B. ORDNANCE TASKS OF THE UNTL 


CVBG ordnance task descriptions are listed verbatim from 


reference [1] and described below. MOES described in Chapter II are 
provided for each task. These MOEsS allow the BGCDR to determine 
various levels of CVBG combat effectiveness. The ultimate purpose for 


each task is clarified when the MOES are listed with their task 
description. 

eee NTA 4.1.1 Schedule/Coordinate Armament of Task Force 

Task Description: Schedule and coordinate armament and rearmament 
of naval/amphibious forces to ensure provision of continued support to 
forces operating both at sea and ashore. This task includes 
Replenishment-at-Sea (Underway Replenishment (UNREP)) and from ashore. 

This task considers the ability of shuttle ships to replenish the 
CVBG (e.g., the combatant ships and the assigned multi-purpose logistic 
support ship known as the station ship). Refer to figure 3.1. An 
UNREP is a transfer of liquid or solid cargo between two ships while 
underway via connected replenishment (CONREP) or vertical replenishment 
(VERTREP) by helicopter. [{Ref.13] Shuttle ships are UNREP capable cargo 
ships that shuttle between the source of supply and the battle group to 
replace the actual or planned expenditures of the CVBG.[Ref.8]° Shuttle 
ships are generally single product, e.g., ordnance, fuel, or stores, 
and must possess the capability to UNREP their products to the CVBG. 

Arming the task force includes supplying ordnance for use in a 


ship's weapon system, aircraft or forces ashore. 
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Figure 3.1 Representation of Ordnance Task 1. 


There are two MOEs that support this task. The first MOE, time 
off station [Ref.6], is the time not dedicated to the CVBG combat 
mission. The time that the CVBG spends moving towards the UNREP 
location and conducting the UNREP is time spent not dedicated to the 
combat mission. 

The second MOE, percent of maximum capacity experienced [Ref.6], 
is the percent difference between the maximum ordnance capacity of the 
entire CVBG and the minimum ordnance level experienced after ordnance 
expenditure. This MOE is useful to the BGCDR in comparing where the 
current CVBG ordnance level falls within acceptable levels. 

Zr NTA 4.1.2 Provide Munitions Management 

Task Description: To project and allocate available munitions 
stocks in’ accordance with combat priorities to weight the main effort. 

Ordnance expenditures are the most difficult to estimate and 
forecast because they are event driven - conflict-dependent - and thus 
related dynamically to the nature and scope of a specific combat or 
exercise engagement. [Ref.14] Major contributors to the dynamic nature 


of combat and exercises are the conditions in which they occur. The 


ie 


UNTL provides a listing of those various conditions that may affect 
ordnance expenditure. 

Once ordnance requirements are determined, allocating the 
ordnance to the CVBG assets is required. This task is similar to the 
First armament task because it deals with allocating assets via UNREP. 

The first MOE, percent of maximum capacity experienced [Ref.6], 
is the percent difference between the maximum ordnance capacity of the 
entire CVBG and the minimum ordnance level experienced after ordnance 
expenditure. 

The second MOE, time off station [Ref.6], 1S the same as that 
mentioned for the first ordnance task. This MOE 1S appropriate because 
part of the task description is to allocate munitions’ stock. te 
describes the time effectiveness of the CVBG’S combat effort in 
allocating additional ordnance via UNREP. 

a NTA 4.1.3 Provide Munitions, Pyrotechnics, and Specialty 

Items 

Task Description: To supply munitions items such as smali arms 
ammunition, grenades, “mines, Pies missiles, torpedoes, 
countermeasures, and naval gun, tank and artillery rounds. 

This task incorporates the UNREP system and 1S similar to the 
first ordnance task - Schedule/Coordinate Armament of Task Force. The 
difference between the two is that this task considers the shuttle 
ships directly replenishing the station ship and the combatant ships 
with the specific munitions type. Figure 3.2 shows what this task 


does. 
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Figure 3.2 Representation of Ordnance Task 3. 


The first MOE, percent of maximum capacity experienced [Ref.6], 
1s the same as that mentioned for first ordnance task, NTA 4.1.1. Tie 
pertains to the minimum ordnance level attained from ordnance 
expenditure. The MOE is utilized to describe the shuttle ships 
replenishing either the CVBG’s station ship or combatant ships. 

The second MOE, time off station [Ref.6], is the same as that 
mentioned for the first ordnance task, NTA 4.1.1. This MOE is 
appropriate because it describes the time effectiveness of the CVBG’s 


combat effort in allocating additional munitions via UNREP. 


Cc. FUEL TASKS OF THE UNTL 

The following CVBG fuel task descriptions are taken verbatim from 
reference [1]. MOEs are also provided for each task. 

Le NTA 4.2.1 Conduct Fuel Management 

Task Description: To monitor and forecast fuel requirements. To 
manage the distribution of petroleum products based on forecasted unit 
requirements and availability. 

This task is similar to the ordnance task - Provide Munitions 


Management - because it deals with predicting needs and allocating 


assets. Fuel consumption can be more precisely estimated than any 
other consumable because it 1S more time-dependent than event- 
driven. [Ref.14] [(Ref.15] Petroleum products described here include 
fuels, oils, lubricants, and greases. [Ref.1] 

The first MOE, time on station lost [Ref.8], transforms the 
utility of having fuel available for the CVBG to time units. 
Forecasting the correct amount of fuel in terms of time that the CVBG 
requires 1S a critical element in CVBG mission accomplishment. 
Underestimating fuel requirements inhibits the ability of the CVBG to 
remain underway, while overestimating is not as detrimental. This MOE 
measures the CVBG underway time lost due to forecasting error. 

The second MOE, percent of maximum capacity experienced [Ref.6], 
is the percent difference between the maximum fuel capacity summed over 
the entire CVBG and the minimum fuel level (summed over the entire 
CVBG) experienced. It pertains to the minimum fuel level attained from 
being underway. This MOE considers the entire CVBG (e.g., combatant 
ships and station ship) being replenished by shuttle ships. 

oe NTA 4.2.2 Schedule/Coordinate Refueling 

Task Description: Schedule and conduct fueling and replenishment 
of naval/amphibious forces to ensure provision of continued support to 
forces operating at sea and ashore. Includes Replenishment-at-Sea 
(UNREP) and from shore. 

This task is very similar to the task Schedule/Coordinate 
Armament of the Task Force, the primary difference being the resource 
involved. The resource for this task is fuel. Whether it is fuel for 
ships or aircraft, this task covers the process of getting that fuel to 
the CVBG. 

The first MOE, time off station [Ref.6], is similar to that 


mentioned for the first ordnance task. It 1S the time not dedicated to 


the CVBG mission due to refueling needs. The second MOE, percent of 
maximum capacity experienced [Ref.6], is the same as that mentioned in 
the first fuel task. 

36 NTA 4.2.3 Conduct Aerial Refueling 

Task Description: Schedule and conduct air-to-air refueling with 
tanker aircraft. 

Airborne refueling significantly extends the range and endurance 
of combat aircraft. It increases effective operating tempos and it 
enhances flexibility in the employment of both land and sea-based 
aviation forces. Therefore, it is important that the aerial refueling 
process and the aerial refueling logistics supply pipeline perform 
well. Appropriate MOPs will help assess the outcome of these 
processes. With the impending retirement of the KA-6D Intruder, the 
Navy’s primary refueling aircraft, the Navy will rely on the Air 
Force’s KC-135 and KC-10 tankers for tactical airborne refueling 
support. [Ref.10] The focus here is on how well the KC-135 supports 
Navy refueling requirements. 

The first MOE, number of aircraft that could have been refueled 
[Ref.9], measures how many more combat aircraft could have been 
refueled for a specific refueling evolution. This MOE compares the 
rate of fuel transfer actually used to the maximum rate of fuel 
transfer under the constraints of the time, the number of tankers used, 
and the amount of fuel carried by the tankers. The results of the MOE 
give the number of aircraft, in addition to the aircraft originally 
planned to refuel, that the tankers could have refueled (e.g., 8 
aircraft were planned to be refueled; all 8 were refueled plus an 
additional 3. MOE = 3.) 

The second MOE, number of aircraft that could not be refueled 


[Ref.9], accounts for the combat aircraft that could not be refueled 


i) 
2 


during a specific refueling evolution due to constraints on time, the 
rate of fuel transfer, and the amount of fuel needed by the combat 
aircraft. It is closely related to MOE 1 above except that it measures 
how many of the originally planned aircraft to refuel could not be 
refueled (e.g., 8 aircraft were planned to be refueled, but only 6 
could) be refueled. MOB@= 98-6 = Zr 

The third MOE, time on station [Ref.10], is the time utilized for 
refueling the combat aircraft based upon the actual fuel transfer rate 
used. It measures the time difference between a specific refueling 


evolution and a refueling evolution that uses the maximum possible 


transfer rate. This MOE iS appropriate because time is a critical 
element in combat. It 1S important because not every refueling 
evolution uses the maximum fuel transfer rate. [Ref.10] The MOE will 


determine the impact on time that results from not using the maximum 
transfer rate. 

4. NTA 4.2.4 Move Bulk Fuel 

Task Description: To move bulk fuels by tankers, rail Cank Gees 
hose lines, or bulk transporters to using or refueling units. 

From the CVBG’S perspective, this task describes the process of 
shuttle ships (1.e., tankers) Semaine fuel to the CVBG station ship or 
combatant ships. This task is very Similar to the ordnance task 
Provide Munitions, Pyrotechnics, and Specialty Items. Performance in 
this task is vital for continual sustainment of the CVBG. 

The first MOE, time off station [Ref.6], is saiamilar to that 
mentioned for the first ordnance task. It is the time not dedicated to 
the CVBG mission due to refueling needs. 

The second MOE, percent of maximum capacity experienced [Ref.6], 
is the percent difference between the maximum fuel capacity and the 


minimum fuel level experienced. It pertains to the minimum fuel level 
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attained from being underway. This MOE considers the entire CVBG 
(e.g., combatant ships and station ship) being replenished by shuttle 
ships. 

oe NTA 4.2.5 Provide Packaged Petroleum Products 

Task Description: To provide packaged products including 
jubricants, greases, hydraulic fluids, compressed gases, and speciality 
items that are stored, transported, and issued in containers with a 
capacity of 55 galions or less. 

This task describes the packaging responsibilities for the 
products listed in the task description. “Packaging” includes 
preservation-packaging, packing, preparation of unit loads, and the 
marking of packages and unit loads. [Ref.11] The following definitions 


taken from reference [11] apply: 


e Preservation-Packaging. Application or use of protective 
measures, including appropriate cleaning and drying methods, 
preservatives, protective wrappings, cushioning and interior 
containers, and complete identification marking, up to but not 
including the exterior pack. 


e Packing. Application or use of shipping containers and 
assembling of packaged or unpackaged items therein, together 
with necessary biocking- Digaleiaig, cushioning, and 
weatherproofing, plus exterior strapping or reinforcement and 
marking. 

e Unit Load. An assemblage of two or more items (in or out of 


containers) in a manner designed to permit handling of the 
items as a single entity using material handling equipment. 


e Marking. Application, by (stamping, palnting. or Prineing sor 
numbers, item name, Federal stock number, symbols or colors on 
containers, tags, labels, or items for identification durang 
shipment, handling, and storage. 


The only MOE, efficiency in packaging petroleum products 
[Ref.11], measures how well the transferred petroleum products are 
packaged. This MOE compares the perfect packaged products to those 
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that are determined unusable (1i.e., improper preservation-packaging), 
mislabeled (i.e., improperly marked), and damaged (1.e., poor packing) . 
Most petroleum products are packaged in 12-gallon or 55-gallon steel 


drums. [Ref.16] 


Di CLOSING 

This chapter described the ordnance and fuel tasks of the UNTL 
tom “a CVBG. MOEs were provided to assist comprehending the ultimate 
purpose for each task. This should prepare the way for the next 
chapter: the method used to apply the task descriptions and MOEs from 
this chapter into an analytic approach to ascertain the quantifiable 
variables (ane. , the variables that are measurements eye task 


performance) that comprise the MOPs. 


LV METHODOLOGY 


This chapter describes the six steps in the process of defining 


MOPs and determining their usefulness in measuring task performance. 


The following issues are discussed: (1) the terms objective, MOE, MOP, 
quantifiable variable, and criteria; (2) the twelve criteria used to 
qualitatively validate the MOPs; (3) a general description of the 


Simulations used to derive data to conduct the quantitative analysis; 


and (4) the validation of the MOPs. 


A. STEPS TO DEVELOP VALID MOPs 

The analytic process used for this research is an adaptation of 
that discussed in reference [17]. This application provides an 
orderly and systematic procedure to develop MOPs by analyzing the 
process of each task. The process steps are listed below and 


described. The steps for each task are as follows: 
e Step 1. Define the Objectives and MOEs of the mission. 


e Step 2. Select the Quantifiable Variables of the Objectives. 


e Step 3. Determine the Measures of Performance. 
e Step 4. Verify the measures of performance against Criteria. 


e Step 5. Perform Correlation Analysis on the MOPs with their 
respective MOE. 
, Step 1 - Objectives and MOEs 
Step 1, Define the Objectives and MOEs of the task, provides a 
clear understanding of the purpose(s) of the UNTL pLanere and fuel 
logistic tasks that are used in determining CVBG performance. The 
objectives of each task are subjectively derived from the task 


description taken from the UNTL. To define the MOPs needed to measure 


the accomplishment of the objectives, an MOE is defined to associate 
the MOPs with the objectives. The MOEs used here are those mentioned 
with the task descriptions described in Chapter III. To zElustrate: 
the description for the UNTL task Conduct Aerial Refueling is to 
“schedule and conduct air to air refueling with refueling tanker 
aircraft”; the objectives are to properly schedule and conduct the 
operation; the MOE may be time to conduct the refueling evolution (time 
on station). 

oe Step 2 - Quantifiable Variables 

Step 2, Select the Quantifiable Variables of the Objectives, 
provides the specific characteristics of the task objectives to be 
measured. Bach task process 1S analyzed to determine what physical 
measurements are required that would describe the task’s performance 
and achieve its objectives. Those measurements are the quantifiable 
variables. The MOES are used to help determine what variables to 
define. These MOES link the MOPs and a task’s objectives. The 
quantifiable variables are combined to develop the MOPs. For example, 
1f conducting an UNREP is the task’s objective and the percent of 
maximum capacity experienced is the MOE, then the quantifiable 
variables could be the “rate of fuel transfer” and the “amount of fuel 
to transfer.” Both variables are required to describe the task’s 
performance and to achieve the objective. A listing of each task’s 
quantifiable variables is provided in Appendix C. 

See Step 3 - Measures of Performance 

Step 3, Determine the Measures of Performance, lists the MOPs 


that have been subjectively determined based upon the quantifiable 


variables of each task. As mentioned earlier, an MOP is based upon any 
combination of quantifiable variables (i.e., one or more quantifiable 
variables can determine an MOP). For example, if the “rate of fuel 
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transter” and the “ame@mt of fuel to transfer” are a task’s 
quantifiable variables, then an MOP can be the percent of the needed 
fuel that was transferred. The MOP depends upon both variables, and it 
describes task performance. A listing of each task’s MOPS are provided 
in Chaptenesl- 

4. Step 4 - Criteria 

Step 4, Verify Measures of Performance against Criteria, provides 
twelve criteria taken from the UNTL and used to ensure the MOP selected 
is valid. The criteria are applied to each MOP developed in Step 3 to 
ensure it passes a qualitative test (e.g., “common sense test”). 
Completion of Step 4 answers the first question posed by this thesis, 
“What measures of performance can be well-defined for each task within 
the ordnance and fuel logistic sub-categories of the UNTL?” The 
criteria used are given in Section C of this chapter. 

5. Step 5 ~ Correlation Analysis 

Step 5, Perform Correlation Analysis on the MOPs with their 
respective MOE, provides a quantitative basis for validating MOPs. The 
values of the MOPs are correlated with the values of their MOE to 
determine any strong relationships between them. Correlation analysis 
helps to validate that the MOPs accurately describe task performance by 
comparing their results to those of their respective MOE. A strong 
correlation implies that an MOP has a strong relationship to its MOE. 
Details of the process of correlation analysis are described later in 
this ehaptern 


The last step quantitatively determines the relationship that an 


MOP has with its MOE. Therefore, the second question posed by this 
thesis, “How well do the measures of performance measure task 
performance?”, is answered. Figure 4.1 shows the methodology and the 


relationship between a task’s quantifiable variables, MOP, and MOE. 
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Figure 4.1 MOP Validation Model. 


Be. DEVELOPING VARIABLES, MOES, AND MOPS 

This section intends to further explain how the variables, MOEs, 
and MOPs are developed. The MOPs determined in Step 3 of the 
methodology are derived through the following process that includes 
Step 1 and 2 of the methodology: 

e Determine the task’s desired objectives; 

e Derive MOEsS based upon the determined objectives; 

e Determine the variables that define the MOE; 

e Define MOPs based upon the variables of the MOE. 

2 Determine Task Objectives 

The UNTL provides the task description for each logistic task. 
From these descriptions, key words are derived that help determine the 
objectives for each task. For example, for task NTA 4.1.3 Provide 


Munitions, Pyrotechnics, and Specialty Items, the task description 


begins “To supply munitions items. . .” The key word is supply. The 
objective is determined to be Supply Munitions. Table 4.1 provides the 
objectives for each task that are derived from the key words (in bold) 


of each task description. 





NTA 4.1.1] 1. Schedule UNREP 
PL eonnte unm 

NTA 4.1.2 1. Project Munitions Stocks 
a i 


NTA 4.2.1 1. Monitor Fuel Requirements 










2. Forecast Fuel Requirements 
3. Manage Fuel Distribution 


NTA 4.2.2 l. Schedule UNREP 

pT Econ enn 
NTA 4.2.3 1. Schedule Aerial Refueling 

pT | canaer tert Recing 


Table 4.1 Armament and Fuel Task Objectives. 





Zoe Derive MOES 

MOES, as discussed in Chapter II, are derived from various 
references. After determining a task’s objective, an MOE is derived to 
describe how effective that objective is accomplished. For example, to 
perform a task’s objective of supply munitions, the CVBG must conduct 
UNREPs. An MOE of an UNREP can be Time Off Station. Chapter III 
describes the MOEs used for each task. Table 4.2 gives the objectives 


and MOEs for each armament and fuel task mentioned in Chapter III. 















NTA 4.1.1 I. Schedule UNREP I. Time Off Station 

POMS Lo Coerdnse nme | 2 Minimum tel Exprioned 
NTA 4.1.2 I. Project Stocks I, Minimum Level Experienced 

pO | iicitesicts | 2 Tine OfSiaton 
NTA 4.1.3 I. Supply Munitions I. Minimum Level Experienced 

pm [hei Ln meagan 


1. Monitor Requirements | 1. Time On Station Lost 
2. Forecast Requirements | 2. Minimum Level Experienced 
3. Manage Distribution 


NTA 4.2.2 I. Schedule UNREP I. Time Off Station 
POISE EL contner weer [2 Minion Level Experienced 
NTA 4.2.3 I. Schedule Refueling Number of Aircraft Could Have Refueled 
2. Conduct Refueling 2. Number of Aircraft Could Not be Refueled 


3. Time On Station 
/ 


NTA 4.2.4 I. Move Fuel . Time Off Station 
2. Minimum Level Experienced 
NTA 4.2.5 I. Provide Products I. Efficiency of Packaging 


Table 4.2 Task Objectives and MOEs. 















Se Determine the Variables of the MOE 

This step determines the variables of the MOE that can be 
measured. These variables are the descriptors of task performance that 
affect the MOE. These quantifiable variables are provided in Appendix 
B and C. For example, some of the variables of the MOE Time Off 
Station are the time until all ships ae rese the UNREP location, time 
to complete UNREP connections, and time to disconnect and break-away. 
Each variable describes the task performance through the definition of 
the MOE. 

4. Define MOPs from the Variables 

MOPs are derived from the quantifiable variables determined from 
Step 3. An MOP can be a single variable or be comprised of several 
variables. The MOPs are functions of quantifiable variables to reduce 
the number of variables into fewer descriptors of task performance. 
For example, two MOPs defined for the MOE Time Off Station, are Time 
from Request for Ordnance to Commencing the UNREP and Time to Complete 


the UNREP Evolution. These two MOPs are comprised of the variables 


U2 
tJ 


that help measure the MOE. The relationships used in this thesis 
between the MOEs, MOPs, and variables are provided in Section D 

Once these MOPs are determined, twelve criteria are used to help 
determine if they are well defined MOPs. The criteria are provided ‘in 


Section C. 


es DESCRIPTION OF CRITERIA 

Criteria described here are taken from the UNTL and used in Step 
4 of the methodology. They help ensure that the MOPs selected are 
useful to the BGCDR in assessing performance by evaluating the MOEs. 
These criteria complement the quantitative analysis as part of the 
validation process in selecting MOPs. Using criteria 1s an intuitive 
step in any performance evaluation, and applying these criteria to the 
MOPs will determine what MOPs can be well defined for the tasks. These 
criterion are not to be confused with the definition of criteria 
provided on page 6. The criteria explained on page 6 pertain to the 
ASSHoMMeNwer) AcWant 1 ta tase sect Oe le serge Sci ution. 


The criteria used provide the standards for basing a subjective 


conclusion on the validity of the MOP developed. They are in the form 
of a question that demands a “yes” or “no” response. A “yes” response 
1s considered favorable towards validating the MOP. ee io. HOt 


mandatory for all criteria to have a “yes” response to make the MOP 
completely valid. 
The twelve criteria used to help validate MOPs are as follows: 


e Do the MOPs Address a Result or Product of Task Performance? 


e Do the MOPs Address an Important Dimension of Task 
Performance? 


e Do the MOPs Reflect How the Task Contributes to Mission 
Success? 
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e Do the MOPs Reflect an Aspect of Performance that is Affected 
by Some Condition(s)? 


e Do the MOPs Distinguish Among Multiple Levels of Performance? 

e Can Data on the MOPs be Readily Obtained? 

e Are the MOPs Independent of the Means Employed to Perform the 
Task? 

e Are the MOPs Simple? 

e Do the MOPs Employ an Absolute Scale? 


e Do the MOPs Employ a Relative Scale? 


°e Can the MOPs be Interpreted Independent of Mission Context in 
which they Occurred? 


e Are the MOPs Controllable? 


D DESCRIPTION OF THE SIMULATION MODELS 

A simulation is used here for Step 5 of the methodology to 
produce the data necessary to conduct the quantitative analysis between 
the MOPs and MOEsS. This is for illustrative purposes only. The same 
procedure could be followed with real exercise data. The simulation is 


designed for each logistic task using Excel 97’s Crystal Ball Pro, 


Version 4.0. (Ref.18] Crystal Ball Pro 1s a graphical suite of 
forecasting, risk analysis, and optimization tools for spreadsheet 
users. 


Crystal Ball Pro uses the Monte Carlo simulation technique for 
producing simulated data. This technique uses a random number 
generator to produce numbers based upon the probability distribution 
type and parameters entered for a random variable (e.g., quantifiable 
variable). The Monte Carlo technique is good for simulating the 


uncertainty of conditions that exist in the real world. [Ref.18] 


Le Designing the Simulation Models 
Three steps are taken to design each task’s simulation model. 


Each step is discussed in the next sections. 


e Step 1: Assign Distributions. List all of the quantifiable 
variables onto the spreadsheet and assign a probability 


GQistribution for each one. 


e Step 2: Assign Parameters. Input the distribution parameters 
that describe the shape of each assumption variable’s 
probability distribution curve. 


e Step 3: Model the MOPs and MOEs. List the MOPs onto the 
spreadsheet and model them as a function of their associated 


quantifiable variables. List the MOEs onto the spreadsheet 
and model them as a function of the MOPs. 
25 Steps 1 and 2 - Assigning Distributions and Parameters 
Assigning probability distributions and their parameters (e.g., 
the mean, mode, endpoints, etc.) for the quantifiable variables 
requires an heuristic procedure due to the absence of full distribution 


data on the quantifiable variables. The procedure for developing 


distributions is taken from reference [19] and consists of four steps. 
e Step 1. Identify a range [a,b]. 


e Step 2. Select a probability distribution on [a,b] 
representative of the variable (e.g., quantifiable variable). 


An assumption is made that the quantifiable variables are 
represented by the Beta distribution. The Beta distribution is a good 
choice to use in simulations in the absence of distribution data 
because “of the variety of shapes the beta density function can 
assume.” [Ref .19] The Beta distribution proves useful in modeling the 
behavior of random variables that are positive and bounded in 
nature. [Ref.20] 

Realizing that the Beta distribution is continuous, this thesis 
uses the approach of rounding the simulation’s generated value to the 
next higher integer for the variables that are discreet by nature. For 


example, if the model generates a value for the number of aircraft 


requiring fuel of 7.2786, the model rounds the value to 8. Further 
calculations are based upon this value. 

The Beta distribution can assume shapes similar to the Normal, 
log Normal, exponential, triangular, and uniform distributions, as well 
as others. Because of this flexibility and the uncertainty of what the 
actual distributions are for the data, the Beta distribution is chosen 
to represent the probability distribution for the quantifiable 
variables. 


e Step 3. Give subjective estimates of the unknown parameters 
(e.g., the mean, wu; the mode, c). 


The majority of the values for the mean (uu) and the mode (c) of 
the quantifiable variables are found in references (8), (9), (10), 
(13), (14), and (16). For those not available, estimates are used which 
are based on the experience of the author. 

For example, for the task Conduct Aerial Refueling, the mean of 
the quantifiable variable (e.g., number of aircraft requiring fuel) is 
determined from reference [10] to be 5.875 aircraft requiring fuel. 
The mode is given by Peneeenee [10] to be 8 aircraft requiring ie 
For the task Schedule/Coordinate Armament of Task Force, the author 
subjectively sets the mean and mode for the quantifiable variable speed 
of the ships used to arrive at the UNREP location as 20 knots and 15 
knots, respectively. Refer to Appendix C for the mean and mode values 
used in the simulations. 


e Step 4. Solve to obtain the following estimates of a, and Q), 
the Beta distribution’s parameters. [Ref.19] 


x — (H-a)2c-a-d) aan 
© (c-HXb-a) | 


z - ob, (aes 


Q, = -_—_r-_——_——_ 


- 
Ua 


A consequence to this heuristic approach for assigning values to 


the parameters of the Beta distribution is that the values for u and c 


cannot be equal. Otherwise, aQ@, 1s undefined. Because wu and c are 
characteristics of the real world, they may be equal. The Beta 
distribution can still be used if the mean and mode are equal. The 


reader must determine values for a, and a, that describe the shape of 
the Beta distribution, insert those values into the simulation, and 
then proceed to run the simulation. 

Si Step 3 - Modeling the MOPs and the MOEs 

Once the Beta probability distributions are defined from 
equations 4.1 and 4.2 for each quantifiable variable, they are 
implemented into Crystal Ball Pro. The MOPs are modeled as functions 
of the quantifiable variables. Appendix B shows what variables the 
MOPs use. The functional relationship defined by this thesis between 
the MOPs and the variables are provided later in this section. The 
MOES are modeled as functions of either the (1) variables, (2) 
variables and MOPs, or (3) MOPs. Their functional relationships 
defined by this thesis are also provided later in this section. All of 
these functions are implemented into the model. The model generates 
values for the quantifiable variables based upon the associated Beta 
DEobability “distribueren In turn, values are generated for the MOPs 
and MOEs. Figure 4.2 describes an example of the Crystal Ball 
Simulation output used for the task Conduct Aerial Refueling. 

The correlation analysis conducted between the values of the MOPs 
and MOES serve merely as an example of the methodology because real 
data obtained on the MOPs include the impact of other variables. A 


statistical approach is used because (1) the method is simple and 


effective, and (2) the analysis of the real data obtained on the values 


of the MOPs are better analyzed using a statistical approach. 


Mean Mode Left Right Alpha1 Alpha 2 


5875 8 , 


13281 7500 6250 50000 1.146727) 5.988717 
19.28125 9.5 G.29 32 1.088193] 2.587482 


Quantifiable Variables: Calculated 


Values 


Number of Aircraft Requiring Fuel | ss 8 Aircraft 
Amount of Fuel Needed per Aircraft 7918.065|Pounds/aircraft 
Time to Refuel per Aircraft 24.11366/Minutes/aircraft 


MOP: 


Fuel Transfer Rate per Tanker 328.3643]Pounds/minute Simulated 
Time to Refuel all Aircraft 192.9093}Minutes << 1 Output 
Ratio of Receivers to Tankers | ss 8 Alircraft/tanker Data 


MOE: 


Number of AC Could Have Refueled | 39} Aircraft 
Time On Station 152.7442|Minutes 
Number of AC Could Not Refuel | sO Aiircraft 





Figure 4.2 One simulation trial in Crystal Ball Pro. The first 
section shows the input values for the mean, mode, the interval (1.e., 
Left and Right endpoints of the range), and the values calculated for a, 
and a, (i.e., Alpha 1 and Alpha 2) for the three quantifiable variables. 
The second section lists the three quantifiable variables and their 


Simulated values generated from their distribution functions. The 
third and fourth sections list the MOPs and MOEs and their simulated 
values generated from their functions. 1000 trials are combined to 


develop distributions of MOPs and MOEs. 


Each time a trial is conducted, Crystal Ball Pro uses the Monte 
Carlo simulation technique to calculate a new value for each 
quantifiable variable, MOP, and MOE. The equations are shown in later 
in this section. For each simulation run, 1000 trials are used. 
Values are calculated for the quantifiable variables, MOPs, andaeiaE. 


and empirical probability distributions are determined. 


Number of Aircraft Requiring Fuel Amount of Fuel Needed per Aircraft Time to Refuel per Aircraft 
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Number of Aircraft Available to Refuel 
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Histogram for the MOE 





Figure 4.3 Combining Distributions. This figure represents an 
example of how Crystal Ball Pro displays the probability distributions. 
The top row of figure 4.3 shows the Beta probability distributions of 
the quantifiable variables. The middle row shows the simulated 
distributions of the MOPs. The bottom row shows the simulated 
distribution of one of the MOEs. 

The values obtained for the MOPs and MOES from the simulations 
are used to conduct the quantitative analysis. The values of the MOPs 
are correlated with the MOE’ values to ascertain any strong 
relationship. The following sections provide the equations of the MOEs 


and MOPs used in the simulation. The variables are the quantifiable 


variables listed in Appendix B and C. 


a) NTA 4.1.1.1 MOE and MOPs 
The MOE Time Off Station (TOSoprp) 1S described in 
equation 4.3, 
TOSorp = TTCorn + TFR , (4.3) 
where, 


TTCorp = Time to Complete the UNREP Evolution; 
TFR Time from Request for Ordnance to Commencing UNREP. 


The MOPs defined for this MOE are as follows: 


TTCorp = Time to Repair UNREP Gear + Time to Complete UNREP Gear Checks 
+ Time to Repair Helicopter Problems + Time Required to Launch Helicopter 
+ Time to Station UNREP Personnel + Time to Ready UNREP Gear 
+ Time to Position Ships Alongside + Time to Complete UNREP Connections 
+ Time to Stage Ordnance + Time to Transfer Ordnance 
+ Time to Breakdown Ordnance + Time to Disconnect and Break-Away ; (4.4) 
TFR= Time to Submit UNREP Request + Time to Determine Ordnance Availability 
+ Time to Submit UNREP Order + (Distance/Speed) used to Arrive at UNREP Location. 
(4.5) 


b) NTA 4.1.1.2 MOE and MOPs 


The MOE Minimum Level Experienced (MLEop,j) 18 described 


in equation 4.6, 


7 Ea [CombOr dReq + StatOrdReq — (POX * (CombOrdReq + StatOrdkeq )| (4.6) 
a MaxCVBGOrdCap 


where, 


CombOrdReq = Ordnance Requirements for Combatant Ships; 

StatOrdReq = Ordnance Requirements for the Station Ship; 

MaxCVBGOrdCap = Maximum Ordnance Capacity of Combatant Ships (700 
tons) + Maximum Ordnance Capacity of Station Ship 
(2100 tons) = 

POX = Percent of the Needed Ordnance Transferred; 


ana POX iS the Elrst MOP. defined as 


(4.7) 
Amount of Ordnance Transferred | 


BoA 
CombOrdReq + StatOrdReg 
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The second MOP used for this MOE is defined as 


Ordnance Available onthe Shuttle Ship (4.8) 


RatioSStoC VBG = 
CombOrdReq + StatOrdReq 


where, 


RatioSStoCVBG = Ratio of the Ordnance Available onboard the 
Shuttle Ships to the CVBG Ordnance Requirements. 


e) NTA 4.1.2.1 MOE and MOPs 

This MOE is described by equation 4.6. Refer to 
Section (b) for the equations used for this MOE and its MOPs. 

d) NTA 4.1.2.2 MOE and MOPs 

This MOE is described by equation 4.3. Refer to 
Section (a) for the equations used for this MOE and its MOPs. 

e) NTA 4.1.3.1 MOE and MOPs 

This MOE is described by equation 4.6. Two MOPs used 


for this MOE are 


OEE ANGE OE 2 
CombOrdReq 


RatioSStoC omb = 


and 


Ordnance Available on the Shuttle Ship (4.10) 
StatOrdReq 


RatioSStoS tat = 


where, 


Ratio of the Ordnance Available onboard the 
Shuttle Ships to the Combatant Ship Ordnance 
Requirements; 

Ratio of the Ordnance Available onboard the 
Shuttle Ships to the Station Ship Ordnance 
Requirements. 


RatioSStoComb 


RatioSStoStat 


A third MOP used for this MOE is the Percent of the Needed 
Ordnance Transferred (POX). Refer to equation 4.7. 
fe) NTA 4.1.3.2 MOE and MOPs 
This MOE is described by equation 4.3. Refer to 


Section (a) for the equations used for this MOE and its MOPs. 
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g) NTA 4.2.1.1 MOE and MOPs 
The MOE Time On Station Lost (TOSL) is described in 


equation 4.11, 


{(CombFuelReq + StatFuelReq)- (PFID * [c ombFuelReq + StatF uelReq))} (4.1m 


LOSE = 
Combatant Ship's Fuel Usage Rate + Station Ship's Usage Burn Rate 


where, 


CombFuelReq = Fuel Requirements for Combatant Ships; 
StatFuelRegq = Fuel Requirements for the Station Ship; 
Combatant Ship’s Fuel Usage Rate = 6,300 barrels/day; 
Combatant Ship’s Fuel Usage Rate = 900 barrels/day; 


ana PFID is the Eirst. MOP deftinea as 


PFID = Amount of Fuel Correctly Identified (4.12) 
CombFuelReg + StatFuelReq 
where, 
PFID = Percent of the Needed Fuel Quantity Correctly 
Identified. 
The second MOP used for this MOE is defined as 
Sh hi 
FuelRatioSStoCVBG = Fuel Available on the Shuttle Ship | (4.13) 
CombFuelReq + StatFuelReg 
where, 
FuelRatioSStoCVBG = Ratio of the Fuel Available Onboard the 
Shuttle Ships to the CVBG Requirements. 
The third MOP used for this MOE is defined as 
PFY = Amount of Fuel Transferred | Re 
CombFuelReg + StatFuelReq 
where, 


PFX = Percent of the Needed Fuel Transferred. 


By NTA 4.2.1.2 MOE and MOPs 
The MOE Minimum Level Experienced (MLE rye) 1s 


described in equation 4.15, 


MLE = 
FUEL MaxCVBGFtuelCap 


where, 


MaxCVBGFuelCap = Maximum Fuel Capacity of Combatant Ships (60,000 
barrels) + Maximum Fuel Capacity of Station 
Ship (10,250 barrels). 


The MOPs used for this MOE are FuelRatioSStoCVBG and PFX. Refer to 


equations 4.13 and 4.14. 
1) NTA 4.2.2.1 MOE and MOPs 
The MOE” Time "GLE Station (TOS) )1s desert t>ecdaain 
eval ilon 4.216, 
FOS TPCe ae, (4.16) 
where, 


TTCrve, = Time to Repair UNREP Gear + Time to Complete UNREP Gear Checks 
+ Time to Repair Helicopter Problems + Time Required to Launch Helicopter 
+ Time to Station UNREP Personnel + Time to Ready UNREP Gear 
+ Time to Position Ships Alongside + Time to Complete UNREP Connections 
+ (Amount of Fuel to Transfer/Fuel Transfer Rate) 
+ Time to Disconnect and Break-Away, (4.17) 


TFR= Time to Submit UNREP Request + Time to Determine Fuel Availability 
+ Time to Submit UNREP Order + (Distance/Speed) used to Arrive at UNREP Location, 


(4.18) 
are the MOPs defined for this MOE; 
TTCrye, = Time to Complete the UNREP Evolution; 
TFR = Time from Request for Fuel to Commencing the UNREP. 
a NTA 4.2.2.2 MOE and MOPs 
This MOE is described in equation 4.15. Refer to 


Section (h) for the equations used for this MOE and its MOPs. 


k) NTA 4.2.3.1 MOE and MOPs 
The MOE Number of Aircraft Could Have Refueled 


(NACHR) is described in equation 4.19, 


NACHR = METR-AFIR oop ACRE (4.19) 
CA Cer ener, FuelAC 
where, 
MFTR = Maximum Fuel Transfer Rate Possible (2,000 lbs/min) ; 
ACRefuel = Number of Aircraft Requiring Fuel; 
FuelAC = Amount of Fuel Needed per Aircraft. 
The MOPs used are AFTR, RATIOgjctaner, and T7TR and are defined as 
Maye FuelAC (4.263 
(Time to Refuel per Aircraft)* (Number of Tankers Needed) 
RATIO jerranter = i EC, (4.21) 
Number of Tankers Needed 
TTR= (A CRefuel ) * (Time to refuel per Aircraft }} (4722) 
where, 
AFTR = Rate of Fuel Transfer per Tanker Actually Used; 
RATIOnc/ranker = Ratio of Combat Aircraft per Tanker; 
TTR = Time to Refuel All Combat Aircraft. 
This MOE measures the number of aircraft that can be refueled in 
addition to the originally planned aircraft. The MOE compares the 


maximum fuel transfer rate possible for the tankers to the fuel 
transfer rate actually used under the constraints of ACRefuel, FuelAC, and 
the time allotted to refuel per aircraft. 

The model proceeds with the NACHR calculations under the 
constraint AFTR < MFTR. When AFTR = MFTR, the model assigns the value 
of zero to NACHR because the tanker’s fuel transfer rate has reached 


the maximum rate possible; no additional aircraft can be refueled. 


44 


1) NTA 4.2.3.2 MOE and MOPs 
Them MOE “Nunpen On mer rCcralt “Could Not be Refueled 


(NACNR) is described in equation 4.23, 


AFTR-MFTR , 77, , ACRefuel (4.23) 
RAO Ae FuelAC 


NACNR = 

The MOE is measuring the number of aircraft that could not be 
refueled under the constraints of ACRefuel, FuelAC, and the time allotted 
to refuel per aircraft. When the refueling evolution is constrained by 
these variables, the model calculates the actual fuel transfer rate 
required to refuel all aircraft needing fuel and satisfy those 
constraints. The model then compares that value to the maximum fuel 
transfer rate possible by the tankers to determine how many aircraft 
could not be refueled. 

The model proceeds with the MNACNR calculations under the 
constraint AFTR > MFTR. When AFTR < MFTR, the model assigns the value 
of zero to NACHR because the actual fuel transfer rate required to 
refuel all aircraft is within the acceptable transfer rate possible. 
As long as the required transfer rate is less than the maximum transfer 
rate possible, all aircraft can be refueled. The MOPs are AFTR, 
RATIO sctaneer, anGQ TTR. Refer to Section (k). 

m ) NTA 4.2.3.3 MOE and MOPs 
The MOE Time On Station (TONS) is described in 


equation 4.24, 


(A 4 ) 


ONS = (4CRefuel )* (FuelAC ) | _ F (A CRefuel )* (FuelAC) 


(Number of Tankers Needed )*(AFTR) Number of Tankers Needed )*(MFTR 1 
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The MOE 1S measuring the time difference between the fuel 
transfer rate actually used to the maximum transfer rate possible. The 
model assigns the value of zero to JONS when AFTR = MFTR because the 
transfer rate actually used has reached its maximum possible value; no 
time is lost when the maximum fuel transfer rate is used. 

n) NTA 4.2.4.1 MOE and MOPs 

This MOE is described in equation 4.16. Refer to 
Section (1) for the equations used for this MOE and its MOPs. 

°) NTA 4.2.4.2 MOE and MOPs 


This MOE is described in equation 4.15. Two MOPs are 


Fuel REttoS StOC pit LE EEE (4.25) 
CombFuelReq 

FuelRatioSStoStat = Fuel Available on the Shuttle Ship , (4.26) 
StatFuelReq 


where, 


FuelRatioSStoComb = Ratio of the Fuel Available Onboard the 
Shuttle Ships to the Combatant Ship 
Requirements; 

Ratio of the Fuel Available Onboard the 
Shuttle Ships to the Combatant Ship 
Requirements. 


Hl 


FuelRatioSStoStat 


The third MOP is PFX. Refer to equation 4.14. 
P) NTA 4.2.5.1 MOE and MOPs 
The MOE Efficiency of Packaging (EOP) is described in 


equation 4.27, 


42279 
EOP =\~(PPD + PPI + PPU), 
where, 
PPD = Number of 55 - gallon Drums Damaged + Number of 12- gallon Drums Damaged (4.28) 


Number of 55 - gallon Drums Needed + Number of 12 - gallon Drums Needed 


pp} = Number of 55 - gallon Drums Improperly Labeled + Number of 12 - gallon Drums Improperly Labeled 
Number of 55 - gallon Drums Needed + Number of 12 - gallon Drums Needed 


(4.29) 
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Number of 55 - gallon Drums Found Unusable + Number of 12 - gallon Drums Found Unusable 


PPU= , 
Number of 55 - gallon Drums Needed + Number of 12 - gallon Drums Needed 


b 


(4.30) 


are the MOPs defined for this MOE; 


PPD Percent of Packaged Products Damaged; 
PPI Percent of Packaged Products Improperly Labeled; 
PPU = Percent of Packaged Products Found Unusable. 


ire CORRELATION ANALYSIS 

Correlation analysis, Step 5 of the methodology, measures the 
linear relationship between two random variables, i.e., the MOE and 
MOP] “Computing 2 correlation cockiiecrent (pp, dees Env Seem ord aaa 
Pro calculates the correlation coefficient between every MOP and its 


associated MOE by using the following equation: 


n nH n 
2d XY - DDS, 
t=] 


r=] i=} 





Pry = 
where, 
n = number of trials, indexed by 1; 
X; = variable of the MOP; 
Y; = variable of the MOE. 
Correlation coefficients range between +1.0. It is a number that 


describes the relative strengths of the linear relationship between the 
MOP and MOE. Because this thesis defines the MOPs and MOEs through 
functions, the MOPs and MOEs do correlate. The purpose of the 
correlation analysis is to determine the strength of the MOP-MOE 
relationship. This determination helps understand how well the MOP 


measures task performance relative to the MOE defined for that task. 
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From reference (21), the following criteria determines the 
nominal strength of that relationship: 
© ‘pee 0e8 — Weak correlation; 


© 507550723105 4080 — Moderate correlation; 


o | “ORO e=) |.) koe = Serong Comnmelacionn 

The correlation coefficient is not an indication of causality. 
It merely gives an indication that a relationship between an MOP and 
MOE exists. That relationship shows that if there are changes in the 


MOP, then there is a change in the MOE. [Ref.22] 


CLOSING 
This chapter presented the methodology used to define and 
validate MOPs. Not only are the MOPs assessed against twelve criteria 


as defined in the UNTL, they are also quantitatively assessed against 


MOEs to determine their utility as a measurement tool. The next 
chapter provides the results of the qualitative analysis (1i.e., the 
validation against the criteria) and quantitative analysis. The 


determination of how good the MOPs are in measuring task performance is 


made based upon the results of the analyses. 
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ae DATA RESULTS AND ANALYSIS 


This chapter provides the results of the qualitative analysis 
conducted on the MOPs and the results of the quantitative analysis 
(e.g., correlation analysis) between each MOP and its MOE for each 


Armament and Fuel task. 


A. RESULTS OF THE ARMAMENT TASKS 
The criteria referenced in Step 4 of the methodology in Chapter 
IV are applied to the measures of performance defined for each Armament 


task. Table 5.1 shows how each MOP meets the methodology’s criteria. 
A mark (®) indicates that the MOP does meet the criterion (1.e., the MOP 


answers “Yes” to the criterion). As mentioned in Chapter IV, a MOP 
does not have to meet every criterion to be valid in measuring CVBG 
performance, but a more valid MOP will meet more criteria. Because of 
what criterion 9 and 10 ask, either criterion 9 or 10 has to be marked. 


Refer to Chapter IV for the listing of each criterion. 
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Table 5.1 Results of the Qualitative Analysis - How the Armament MOPs 
Met the Criteria. 
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Table 5.2 displays (1) the results of the correlation analyses 
conducted on the MOPs to their respective MOE, and (2) the Significance 
of each MOP in measuring task performance based upon the criteria 
assigned to the correlation coefficient in Chapter IV, Section E. 
Correlation Level of 
Coefficient Significance 
MOE No._NTAAIAA 

MOPNo._NTA 41.01 
MOP No. NTA 4.1.1.1. Weak 


MOENo._NTA4I.12 Oo 
MOPNo._NTA 4112 






bof me 


MOPNo.NTA 41.1.2 


MOE No. NTA 4.1.2.1 
MOP No. NTA 4.1.2.1. 
MOP No. NTA 4.1.2.1. 
MOE No. NTA 4.1.2.2 


bop 


i 

MOP No._NTA_41.22 
MOP No. _NTA_41.22 

MOE No. NTAAISI ee re 
MOPNo._NTA_4131 

MOP No. NTA_41.31 


hoy ~~ 


: 





No 


MOP No._NTA 4.1.3.1. 
MOE No._NTA41.3.2 oo 
MOP No._NTA_41321 
MOP No._NTA_4.1.3.2.2 


e 5.2 Quantitative Analysis Between the Armament Task MOES and 
MOPS. 






KH 
o: 
te 
Ul 
we 


Be RESULTS OF THE FUEL TASKS 

The criteria referenced in Step 4 of the methodology in Chapter 
IV are applied to the measures of performance defined for each fuel 
task. Table 5.3 shows how each MOP meets the methodology’s criteria. 

Table 5.4 displays (1) the results of the correlation analyses 
conducted on MOPs to their respective MOE, and (2) the significance of 
each MOP in measuring task performance based upon the criteria assigned 
to the correlation coefficient in Chapter IV, Section E. 

Note that for the same fuel task, an MOP may describe task 


performance through one or more MOEs. For example, for the first fuel 
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task, the MOES NTA 4.2.1.1 and NTA 4.2.1.2 have two of the same MOPs. 
Because these MOPs define their respective MOE in a different context, 


the correlation coefficients and COMer out iOons LO Variance are 


different. 
SEEN AIDE? 
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Table 5.3 Results of the Qualitative Analysis - How the Fuel MOPs Met 
the, eriteria- 


Correlation Level of 
Coefficient Significance 


MOE No. NTA 4.2.1.1 i 


ee 

MOPNo._NTA 421.01 

MOP No. NTA _4.2.1.1.2 

MOPNo._NTA 42113} -090 | Strong 
[MOENoNTA@212———SSSCSC~SSCSC~‘“‘~‘“‘~‘;~;<zSSSSOCS 
MOPNo._NTA 42121 

MOP No._NTA_4.2.1.2.2 
[MOENo_NTA@22ISC~SSOSCSCSCSYY SSS 
MOPNo._NTA 42201 
[MOENo._NTAG#222—— |) Cd OS 
MOP No._NTA_4.22.2.2 
[MOENo._NTAG23ISSSCSC~dSCSCS*CS~C“‘“‘“‘;SS*d;COCCCC~CS 
MOPNo._NTA 42311] -090 | _ Strong 

MOP No. NTA 4.23.12 
[MOENo_NTAS232———— SO SCTSSCSC~sSSSCCCSCSCSC~CSCSCSCS 
MOPNo._NTA 42321 

MOP No. NTA 4.23.22 
[MOENo_NTA4233SSSC~SSC“‘“‘SCSCSCSCSSOCSC“‘CNCSC‘“CS™S 
MOPNo. NTA 42331 
[MOP No. NTA 4.23.32 [041 —~S«Weak 
[MOENoNTA@241SSC~dSCSCSC‘“*‘“S*~‘iSC“‘CSNC‘CO 
MOP No. NTA 4241.1 

MOP No.__NTA_42.4.1.2 
[MOENoNTA@Z42—SSC~dSCC‘“‘“CNNSNC*#‘dUTNSCNNCNOC#é‘<‘ 
MOP No. NTA 424.21 

MOP No. NTA 4.24.23 
[MOENoNIA@251SSSSCSdSSCSC—“CS~SSSC“‘;SCOCOCSOOCS 


Table 5.4 Quantitative Analysis Between the Fuel Task MOEs and MOPs. 


tan 
to 


Cs ANALYSIS OF THE MOPS 

db Analysis of MOPs against Criteria 

Tables 5.1 and 5.3 in Chapter V show how the Armament and Fuel 
task MOPs met the criteria provided in Chapter IV, Section C. Even 
though the tables give the results of a qualitative analysis based upon 


a subjective determination of how the MOPs met the criteria, they serve 


as a guideline for determining a well-defined MOP (1i.e., the MOP is a 
good descriptor to use in measuring task performance). The more 
criteria met (1.e., as indicated by the black dot) indicates a well- 


defined MOP. Not all criteria need to be met to be a well-defined MOP. 
Also, either criterion 9 or 10 1s marked, not both. Refer to the 
criterion listed in Chapter IV, Section C. When checking to see if an 
MOP met all criteria, the fact that either criterion 9 or 10 is marked 
1s taken into account. 


The following four Armament task MOPs did not meet all criterion: 


e NTA 4.1.1.2.1 Ratio of Ordnance Available onboard Shuttle 
Ships to the CVBG Ordnance Requirements; 

e NTA 4.1.2.1.1 Ratio of Ordnance Available onboard Shuttle 
Ships to the CVBG Ordnance Requirements; 

e NTA 4.1.3.1.1 Ratio of Ordnance Available onboard Shuttle 
Ships to the Combatant Ships’ Ordnance Requirements; 


e NTA 4.1.3.1.2 Ratio of Ordnance Available onboard Shuttle 
Ships to the Station Ship’s Ordnance Requirements. 


The following seven Fuel task MOPs did not meet all criterion: 


e NTA 4.2.1.1.1 Percent of the Fuel Quantity Correctly 
Identified; 


e NTA 4.2.1.1.2 Ratio of the Fuel Available onboard Shuttle 
Ships to the CVBG Requirements; 

e NTA 4.2.1.2.1 Ratio of the Fuel Available onboard Shuttle 
Ships to the CVBG Requirements; 

e NTA 4.2.2.2.1 Ratio of the Fuel Available onboard Shuttle 
Ships to the CVBG Requirements; 

e NTA 4.2.3.1.3 Ratio of Combat Aircraft per Tanker; 

e NTA 4.2.3.2.3 Ratio of Combat Aircraft per Tanker; 

e NTA 4.2.3.3.2 Ratio of Combat Aircraft per Tanker. 


All of these MOPs dealt with ratios except for NTA 4.2.1.1.1. 
The MOPs that are defined by a ratio did not satisfy Criterion 1, which 
focuses on an MOP measuring a task’s result and not the task’s process. 
These MOPs focus on inputs or resources (e.g., the number of aircraft 
involved in conducting aerial refueling) involved as opposed to the 
outputs or results of the task’s performance. 

The MOP Percent of the Fuel Quantity Correctly Identified did not 
satisfy Criterion 4, which focuses upon the MOP’s ability to be 
affected by external conditions of the environment. This MOP does not 
account for any external conditions when predicting the amount of fuel 
required for the CVBG. An MOP is more useful to the CVBG if it has the 
ability to be influenced by the external conditions that are factors of 
the real world. 

ae Analysis of MOPs Correlated with MOEs 

Tables 5.2 and 5.4 in Chapter V show how the values of the 
Armament and Fuel task MOPs correlated with their respective MOE. The 
MOPs determined to be useful meet either the strong or moderate 
criteria for the correlation coefficient (see Chapter IV, Section &). 

The following five Armament task MOPs have a weak correlation 


with their MOE: 


e NTA 4.1.1.1.2 Time from Request for Ordnance to Commencing 
UNREP; 


e NTA 4.1.2.2.2 Time from Request for Ordnance to Commencing 
UNREP; 

e NTA 4.1.3.1.1 Ratio of Ordnance Available onboard Shuttle 
Ships to the Combatant Ships’ Ordnance Requirements; 


e NTA 4.1.3.1.2 Ratio of Ordnance Available onboard Shuttle 
Ships to the Station Ship’s Ordnance Requirements; 


e NTA 4.1.3.2.2 Time from Request for Ordnance to Commencing 
UNREP. 


The MOPs Time from Request for Ordnance to Commencing UNREP have 
little correlation with their MOE of Time Off Station because the 


values of the time variables of the MOP are not great enough to affect 


54 


the range of values for the MOE. The MOE does not respond 
significantly enough with changes in the values of the MOP to be 
considered a good MOP. 

The MOPs NTA 4.1.3.1.1 and 4.1.3.1.2 have weak correlation with 
their MOE of Percent of Maximum Capacity Experienced because when the 


ordnance requirements of the combatant ships and the station ship are 


considered individually, they do not represent the true ordnance 
requirement of the entire CVBG. When the ordnance requirements are 
considered as a single quantity (e.g., CVBG ordnance requirements = 


combatant ship ordnance requirements + station ship ordnance 
requirements), then the true ordnance requirement is represented. 

The following seven Fuel task MOPs have a weak correlation with 
their MOE: 


e NTA 4.2.2.1.1 Time from Request for Fuel to Commencing the 


UNREP ; 
e NTA 4.2.3.1.3 Ratio of Combat Aircraft per Tanker; 
e NTA 4.2.3.2.1 Rate of Fuel Transfer per Tanker Actually Used; 
e NTA 4.2.3.2.2 Time to Refuel All Combat Aircraft; 
e NTA 4.2.3.2.3 Ratio of Combat Aircraft per Tanker; 
e NTA 4.2.3.3.2 Ratio of Combat Aircraft per Tanker; 


e NTA 4.2.4.1.1 Time from Request for Fuel to Commencing the 
UNREP. 


The MOPs Time from Request for Fuel to Commencing the UNREP have 
little correlation with their MOE of Time Off Station for the same 
reason of the Armament task MOP of Time from Request for Ordnance to 
Commencing UNREP as explained earlier. 

The MOP Ratio of Combat Aircraft per Tanker had weak correlation 
with its MOE because the simulation primarily uses one tanker per 
refueling evolution. One tanker is enough to meet the fuel demand of 
the all the aircraft requiring fuel. Therefore, the ratio did not 
change significantly enough to give good correlation between the MOP 


and the MOE. 


2 


The MOPs Rate of Fuel Transfer per Tanker Actually Used and Time 
to Refuel All Combat Aircraft had weak correlation to their MOE of 
Number of Aircraft that Could Not be Refueled because the simulation 
primarily produced values of the MOE equal to zero (i.e., the number of 
aircraft that could not be refueled per evolution = 0). The tankers 
had enough fuel, enough time, and a fuel transfer rate that enabled all 


combat aircraft to be refueled in most refueling evolutions. 


3% Analysis of Criteria versus Correlation 
The qualitative analysis (1.e., verifying MOPs against the twelve 
criterion) reveals no MOP having significant problems in being 


considered a well-defined MOP. Only one MOP did not meet two of the 
eriterion, ten MOPs did not meet one of the criteriGcn, ances 
remaining 26 MOPs met all criterion. 

The quantitative analysis (1.e., correlating the values of an MOP 
with the values of its MOE) gives a better indication of how well the 
MOPs measure task performance. Even though the qualitative analysis 
helped determine what MOPs can be well-defined, it is the quantitative 
analyses that proved very useful in rating each MOP with a _ strong, 
moderate, or weak description for measuring task performance. 

There is no direct relationship between the MOPs that did not 
meet a criterion to the MOPs with weak correlation. The difference 
lies in the fact that one analysis is strictly subjective and the other 
is more formal in its approach (i.e., use of equations and a 
statistical analysis). To determine a well-defined and useful MOP, no 


conclusion is made by directly comparing the two analyses. 
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V1. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 

The purpose of this thesis 1s to determine measures. of 
performance for the Armament and Fuel logistic tasks designated in the 
UNTL for a CVBG. This thesis answers two questions, "What measures of 
performance can be well-defined for each task within the armament and 
fuel sub-category of the NTA 4 Perform Logistics and Combat Service 
Support tactical level hierarchical listing?", and “How well do those 
measures of performance measure task performance?” 

The conclusions of this thesis are: (1) the 37 MOPs listed in 
Chapter II are defined for the Armament and Fuel logistic tasks; (2) 
based upon the qualitative analysis, all of the proposed MOPs are well- 
defined measures of task performance; and (3) based upon the 
quantitative analysis, only 25 of the 37 MOPs are useful in measuring 


task performance. 


Bi RECOMMENDATIONS FOR USING THE MOPS 

Using the UNTL and the NMETL development process iS a new 
concept. Though this thesis listed applicable measures of performance 
for the given logistic tasks, there needs to be continual improvements 
and modifications made to them with their use in CVBG combat exercises. 
Three steps need to be done for that to occur. First, a database needs 
to be maintained by each CVBG on what tasks and MOPs from the UNTL were 
selected and exercised. Second, the database needs to include the 
BGCDR’s criteria set to the MOPs and the actual outcome performed by 
the CVBG in terms of MOEsS. Third, comparisons need to be made between 
the set criteria and the actual outcomes. The evaluation of the 


results between the actual outcomes and the set criteria can determine 


a7 


if the BGCDR’s set criteria or the MOPs selected are the cause of any 


variations in the expected task’s outcome. 


Cs AREAS FOR FUTURE STUDY 

This thesis covers two of thirteen sub-categories of the UNTL’s 
logistic category, NTA 4 Perform Logistics and Combat Service Support. 
The remaining eleven sub-categories or the sub-categories of the other 
five mission objective categories can be approached in the same manner 
for future research. 

This thesis also gave recommended MOPs based upon the MOEs 
defined for each task. These MOPS and MOES are not all incluSive. 
Other MOEs can be defined for the tasks. These different MOES provide 
different MOPs. 

Further analysis can be conducted on the relationship between the 
MOPs and MOEs. Specifically, multiple regression of the MOPs on the 
MOEsS can help provide more information on their relationships. 

Once the MOPs are fully integrated into CVBG exercises and 
databases have been established, there can be future research into the 
needed modifications of the MOPs used. With the availability of actual 
data, better analysis can be made on the recommended MOPs of this 


thesis or on the determination of other MOPs. 
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APPENDIX B. QUANTIFIABLE VARIABLES FOR THE MOPS 


The quantifiable variables for each Armament and Fuel task are 


listed below. 





Ordnance Requirements for Combatant NIAC 2 INTACT Ae NTA Sa 2 NIA] 2.7.2, 
NTAGIA1A, NTA LIAS 
Ordnance Requirements for the Station | NTA 4.1.1.2.1, NTA 4.1.1.2.2, NTA 4.1.2.1.1, NTA 4.1.2.1.2, 
NTA 41312, NTASIA13 
Ordnance Available on the Station Ship L241, NiAgga Od 1 NTA 44.5 7.2 
Ordnance Available on the Shuttle Ship LZ. 1A eNTAS ST See Ae 3 2 
Time to Submit UNREP Request NTA 4.1.1.1.2, NTA 4.1.2.2.2, NTA 4.1.3.2.2, NTA 4.2.2.1.2, 


Time to Determine Ordnance or Fuel NTA 4.1.1.1.2, NIA F222 NIA 4a 2 NTA 2 
Availability (minutes) NTA 4.2.4.1.2 


Quantifiable Variable Measures of Performance that use this Variable 





Time to Submit UNREP Order NTA 4.1.1.1.2, NTA 4.1.2.2.2, NTA 4.1.3.2.2, NTA 4.2.2.1.2, 
(minutes) NTA 4.2.4.1.2 

Distance to the UNREP Location NIA 1.1L EOeNTA 4.) 2227 Ne 2 2 NTA 2 Oe. 
(nautical miles) NTA 4 rel 2 

Speed used to Arrive at UNREP NTA 4A.1.1.2, NTA 4 ieee TA 4.1 32 A277 2, 
Location (knots) NIA f.27hie2 

Time until Moving Towards UNREP NTA@A 1 .2-NTA 41 222 NTA TS 22h eee 2 
Location (minutes) NTA 4.2.4.1.2 


Time until All Ships Arrive at UNREP NIA 41a, NTA 412 NIA 43321, NTA ie 
Time to Repair UNREP Gear (minutes) NEA 4 lalael, NTA 4.1 .22.15NTA 321A S22 le 
Time to Complete UNREP Gear Checks | NTA 4.1.1.1.1, NTA 4.1.2.2.1, NTA 4.1.3.2.1, NTA 4.2.2.1.], 

Time to Repair Communications NIAmel I 11, NIA G2 2.1, NTA 413 2d, NTS oe, 
Time to Complete Communication NIA 41.111, NTA 4g ZT NIAS TZ, NTA, 





Time to Repair Helicopter Problems NEA 4111 ITONTA 412 2GNTA 4 TSO aie 

Time Required to Launch Helicopter NIA 411A. NIA 4d NTA Be NTA 

Time to Station UNREP Personnel NTA 4.1.0.1.1, NTA 4I.2.2.1, NTA 413.21, NTAB#2Z2 71, 

NTA 11, NOAA 2 27 NTA Se 1, NEA 
NTA 4.2.4.1.1 


Time to Position Ships Alongside NIACE Ill, NTA 2 NTA S52 1 NIA 2 oe 
NTA 4.2.4.1.1 





(minutes) 






Time to Complete UNREP Connections | NTA 4.1.1.1.1, NTA 4.1.2.2.1, NTA 4.1.3.2.1, NTA 4.2.2.1.1, 
(minutes) NTA 4.2.4.1.1 
Time to Stage Ordnance (minutes) NTA Alii NA 4a) 2 Do INA 4 
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Quantifiable Variable Measures of Performance that use this Variable 
Time to Breakdown Ordnance (minutes) NTA 451 NTA Ge eel NTA ee 


Time to Disconnect and Break-Away NTA 4.1 114, NTAG 12241, NTA 4132.1 NIAS 27 ee 
(minutes) NTA 4.2.4.1.] 


NTA 41 er NA eo Ne Ae 
Percent of Ordnance Requirements NTA 4.1.2.1.1 
Percent of Ordnance Requirements NIA 4 120 


Correctly Identified using Experience 
(%) 


Probability of Combat Kill by an NTA 4.1.2.1.1 
Ornnce pe | 

Probability of Combat Engagement by NTA 4.1.2.1.1] 

anOrnnceDpe Bn | 


Amount of Fuel Required by the NTA 4.2.1.1.1, NTA 4.2.1.1.2, NTA 4.2.1.1.3, NTA 42g 
Combatant Ships (barrels) NTA 4.2.1.2.2, NTA 4.2.2.2.1, NTA 42222, NIA 722 
Nadel 2? oe 
NTA 4.2.1.1.1, NTA 4.2.1.1.2, NTA 4.2.1.1.3, NYA 42s 
NTA 4.2.1.2.2, NTA 4.2.2.2.1, NTA 4.2.2.2.2, NTA 4.2 4530 
Nia 24 
NTA 4.2.1.1.1, NTA 4.2.1.1.2, NTA 4.2.1.1.3, NTA 42g 
NTA 4.2.1.2.2, NTA 4.2.2.2.], NTA 4.2.2.2.2, NIA 4235 
NTA 4.2.4.2.2 
Amount of Fuel Available on the Shuttle | NTA 4.2.1.1.1, NTA 4.2.1.1.2, NTA 4.2.1.1.3, NTA 4.2.1.2.1, 
Ship (barrels) NTA 4.2.1.2.2, NTA 4.2.2.2.1, NEA 4.2.2.2.2, NIA 
NAB aoe 


Amount of Fuel Transferred (barrels) NTA 4.2.1.1.3, NTA 4.2.1.2.2, NTA 4.2.2.2.2, NIA Gee 


Amount of Fuel Correctly Identified NTA 4 Zi 
ne 
Number of Aircraft Requiring Fuel NTA 4.2.3.1.2, NTA 4.2.3.1.3, NTA 4.2.3. 2.2, N TAM eee 
Amount of Fuel Needed per Aircraft NTA 4.2.3.1.1, NTA 4.2.3.1.2, NFA 4.2.3. 2.1, NTA 4p 
ia 42.331 
Time Taken to Refuel each Aircraft NTA 4.2.3.1.2, NTA 4.2.3.1.3, NTA 4.2.3.2.2, NTA 4232s 











Amount of Fuel Required by the Station 
Ship (barrels) 






Amount of Fuel Available on the Station 
Ship (barrels) 








Number of 55-gallon Drums Needed NTA 4.2.5.1.1, NTA 4.2.5.1.2, NTA 4.2.5.1.3 
Number of 12-gallon Drums Needed NTA 4.2.5.1.1, NTA 425.12, NIA 4.2 55 





Number of Damaged 55-gallon Drums NTA 4.2.5.1.1 
Number of Damaged 12-gallon Drums INA 4 epee iT 


Number of Improperly Marked 55- NTA 4.2.5.1.2 
pm lonbrme | 
Number of Improperly Marked 12- NTA 4.2.5.1.2 


Number of Unusable 55-gallon Drums INT AA 2. De 
Number of Unusable 12-gallon Drums NTA 4.2.5.1.3 


APPENDIX C. BETA DISTRIBUTION PARAMETERS 


This appendix lists the parameters used to describe the Beta 


distributions of the quantifiable variables used in the simulations. 


Quantifiable Variable Left Bound | Right Bound 


Ordnance Requirements for Combatant 204.6 186 700 
eee Sipetony | ee | LT 
Ordnance Requirements for the Station 2,100 
ee Nip | | 


Ordnance Available on the Station Ship eo 2,100 
(tons) 


Ordnance Available on the Shuttle Ship 5,800 6,000 6,500 
ee eT eee 
Time to Submit Ordnance Request 45 30 i 
pe mma TL 
Time to Determine Ordnance 45 30 /13) 
| atabiiy nim | TLL 
Time to Submit UNREP Order 45 30 1 
ee | ee 
Distance to the UNREP Location 1S 10 30 
pean | TLL 
Speed used to Arrive at UNREP 20 io i 25 
eM ocaion tn | TLL 
Time until Moving Towards UNREP 45 30 120 
pe ecaiontminaes) ||| 
Time until All Ships Arrive at UNREP 
peretacatninimey | | | 


Time to Repair UNREP Gear (minutes) |_20| 73_-+|~0~—~«Y SS 


Time to Complete UNREP Gear Checks 

emg | 
Time to Repair Communications 30 15 

Mima | LT 
Time to Complete Communication 1 10 > 30 

7 a 
Time to Repair Helicopter Problems 15 

emma | LT 
Time Required to Launch Helicopter 30 Zo 10 

eee | 
Time to Station UNREP Personnel 40 

[7 


Ss 
ae |S a 
(minutes) 
Time to Complete UNREP Connections a) 
mina | 
bp to) eae 
aaa aaa 


Time to Stage Ordnance (minutes) 
Time to Breakdown Ordnance (minutes) 


Time to Disconnect and Break-Away 
(minutes) 


Amount of Ordnance Transferred (tons) 


oe fe 
Ln} Gy U 


Quantifiable Variable Left Bound | Right Bound 
Percent of Ordnance Requirements 85 100 
Correctly Identified using Models (%) 


Percent of Ordnance Requirements 70 75 100 
Correctly Identified using Experience 
(%) 





Probability of Combat Kill by an 85 100 
Ordnance Type (%) 
100 


Probability of Combat Engagement by 
an Ordnance Type (%) 


Amount of Fuel Required by the 5,280 4,800 60,000 
Combatant Ships (barrels) 


Amount of Fuel Available on the Station 


Amount of Fuel Required by the Station 10,250 
Ship (barrels) 

Amount of Fuel Available on the Shuttle 84,000 90,000 
Ship (barrels) 


Amount of Fuel Transferred (barrels) 


Amount of Fuel Correctly Identified (note 7) (note 8) a (note 9) 


Number of Aircraft Requiring Fuel Soe | ee 


177,000 
Ship (barrels) 


123,900 132,750 


I! 20,000 


(note 6) 


(7) 


Amount of Fuel Needed per Aircraft 13 2G) 7,500 6,250 50, 000 
(pounds/aircraft)) 
32 


Time Taken to Refuel each Aircraft oo) 9.5 oD 
(minutes/aircraft) a, |e 
Number of 55-gallon Drums Needed ] 
Number of 12-gallon Drums Needed ] 
Number of Damaged 55-gallon Drums 


Number of Damaged 12-gallon Drums (note 10) (note 11) 


Number of Improperly Marked 55- (note 10) (note 11) 
Number of Improperly Marked 1 2- (note 10) (note 11) 


Number of Unusable 55-gallon Drums (note 10) (note 11) 
Number of Unusable 12-gallon Drums (note 10) (note 11) 


500 
500 
(note 12) 
(note 12) 
(note 12) 


(note 12) 


(note 12) 
(note 12) 


Note 1. 95% of the total ordnance required. 


Note : 
Note : 
Note : 
Note 5. 
Note 6. 
Note ; 
Note , 


Note 


Z 


3 


100% of the total ordnance required. 

Equal to the total amount of ordnance required by the CVBG. 
95% of the total amount of fuel required. 

Equal to the total amount of fuel required. 

Equal to the total amount of fuel required. 

90% of the Mode. 

90% of the total amount of fuel required. 


Equal to the total amount of fuel required. 


Note 10. 15% of the total number of drums needed. 
Note 11. 10% of the total number of drums needed. 


Note 12. Equal to the total number of drums needed. 


65 





\O 
\O 


Or. 


ee 


dee 


+. 


LIST OF REFERENCES 


Chief of Naval Operations, OPNAV Instruction 3500.38/ Marine 
Corps Order 3500.26/USCG COMDT Instruction M3500.1, Universal 
Naval Task List (UNTL), Version 1.0, September 1996. 


Naval Doctrine Command, Naval Mission Essential Task List (NMETL) 
Development Handbook, Norfolk, VA, May 1997. 


Webster’s Tllustrated Encyclopedia Dicetenanry, TCrEMone 
Publications, Inc., Montreal, Canada, 1990. 


Raisbeck, Gordon, “How the Choice of Measures of Effectiveness 
Constrains Operational Analysis,” Interfaces, Volume 9, Number 4, 
AUGUSt. 979: 


Giadrosich, DeHaldmmy, Operatiems Research Analysis in Test) and 
Evaluation, American Institute of Aeronautics and Astronautics, 
ine.) Washingcron, D.C. , «1995. 


Schrady, David A., Measures of Effectiveness in Logistics, 
Technical Report, Naval Postgraduate School, Monterey, CA, May 
1989. 


Pas mateic, Steven Eee, Combat LOGriseres Problems, Doctoral 
Dissertation, Operations Research Department, Naval Postgraduate 
School, June 1989. 


Smith, Charles R., Jr., and Foster, Richard E., “Carrier Combat 
Endurance and Replenishment Requirements,” Underway Replenishment 
of Naval Ships, Naval Surface Warfare Center, Port Hueneme, CA. 
Originally presented at the Commander naval Air Force, U.S. 
Pacific Fleet/A.S.N.E. Symposium, San Diego, CA, October 1976. 


United States General Accounting Office, OPERATION DESERT STORM: 
An Assessment of Aerial Refueling Operational Efficiency, Report 
to Congressional Requesters, Washington, D.C., November 1993. 


Killingsworth, Paul S., Multipoint Aerial Refueling: A Review and 
Assessment, Rand Corporation, Santa Monica, CA, 1996. 


Chief of Naval Operations, OPNAV Instruction 4030.1, Packaging 
Responsibilities within the Navy, March 1971. 


Chief of Naval Operations, OPNAV Instruction 3501.316, Policy for 
Carrier Battle Groups, February 1995. 


Chief of Naval Operations, Naval Warfare Publication, FXP 4 
Mobility(MOB), lLogistics(LOG), Fleet Support Operations(FSO), 
Non-Combatant Operations(NCO), and Explosive Ordnance Disposal 
(EOD) Exercises, August 1990. 


67 


ee: 


. 


LG: 


te. 


AS 


iS 


ZO 


ole 


gee 


Wellborne, Raymond B., Captain (USN), Retired, “Battle Group 
Logistics - The Multiplier,” Underway Replenishment of Naval 
Ships, Naval Surface Warfare Center, Port Hueneme, CA. 
Originally presented at the American Society of Naval Engineers 
Meeting in March 1988. 


Schrady, David A., User’s Guide for TACLOGS: Battle Group 
Tactical Logistics Support System, Second Edition, Technical 
Report, Naval Postgraduate School, Monterey, CA, December 1996. 


Department of the Navy, NAVSUP PUB 442: Instructor’s Guide for 


Basic Military Preservation and Packing, Washington, D.C., May 
LS4y= 
Churchman, Ge West and Ratoosh, Philburn, Measurement: 
Definitions and Theories, John Wiley & Sons, Inc., New York, 
Si. 
Comtech Services, pac Crystal Ball User’s Guide, 


Decisioneering, Inc., Boulder, CO, 1988-1991. 


Kelton, W. David, and Law, Averill M., Simulation Modeling and 
Analysis, Second edition, McGraw-Hill, Inc., 1991. 


Larson, Harold J., Introduction to Probability, Addison-Wesley 
Publishing Company, 1995. 


Devore, Jay L., Probability and Statistics for Engineering and 
the Sciences, Third edition, Brooks/Cole Publishing Company, 
Pacific Grove, CA, 1991. 


Larsen, Richard J., and Marx, Morris L., An Introducticumee= 


Mathematical Statistics and Its Applications, Second edition, 
Prentice-Hall, Englewood Cliffs, NJ, 1986. 


68 


BIBLIOGRAPHY 


Anderson, Wayne Hex, Development OF Performance Measures Her 
Organizational Level Aviation Maintenance Managers, Masters Thesis, 
Management Department, Naval Postgraduate School, June 1977. 


Frampton, Judith, and Globerson, Ayre, and Globerson, Shlomo, You Can’t 
Manage What You Don’t Measure, Gower Publishing Company, Vermont, 1991. 


Jung, John D., Performance Measures for Military Sealift Command’s 
Special Mission Oceanographic Ships, Masters Thesis, Management 
Department, Naval Postgraduate School, June 1996. 


McConkey, Dale D., “Writing Measurable Objectives for Staff Managers,” 
S.A.M. Advanced Management Journal, Volume 37, Number 1, January 1972. 


McLay, Deidre L., Performance Measures for U.S. Pacific Fleet Ship 
Intermediate Maintenance Activities, Masters Thesis, Operations 
Research Department, Naval Postgraduate School, September 1992. 


Smith, Robert L., Performance Measurement of a Carrier Battle Group: A 
Case Study of the Commander In Chief, ee Atlantic Fleet’s 
Participation as a Performance Planning and Reporting Pilot Project for 
Fiscal Year 1996, Masters Thesis, Management Department, Naval 
Postgraduate School, December 1996. | 


Sumner, Gerald, Conventional Munitions Requirements Estimation in the 
Navy, A Rand Note, April 1989. 


Wagman, Barry L., “An Approach to Measuring the Productivity of Staff 
Functions,” Public Personnel Management, September/October 1974. 


Wilkinson, Joseph W., “The Meaning of Measurements,” Management 
ACeCOUmeEING, OuUlyedeo 15 


69 


70 





GLOSSARY OF DEFINITIONS 


Con@ltion. Those variables of an operational environment or situation 
in which a unit, system, or individual is expected to operate that may 
affect performance. 


Connected Replenishment (CONREP). BA Neri zontal transfer via connected 


replenishment rigs of liquid and/or solid cargo between two ships while 
underway. 


Criterion or Criteria. A rule, test, or quantitative value on which a 
judgment or decision can be based. 


Forecast Variable. A variable of the simulation model that is a 
function of the assumption variables. Forecast variable is a term used 


to define the measure of effectiveness (MOE) that has been implemented 
into the simulation model. 


Logistics Weighted Combat Value. The concept that describes the 


additional marginal combat value of a resource added to the Carrier 
Battle Group as a function of time. 


Measure. A dimension, capacity, or quantity description to a task. A 
measure provides the basis for describing varying levels of task 
performance. Measure is used interchangeably with Measure of 


Performance (MOP). 


Measure of Effectiveness (MOE). A metric that describes military worth 


On ) Valve. Pemmeasures) OF VetLrectiveness 1S) an Iharvcatormorw attack Ss 
performance upon effective combat operations. 


Measure of Performance (MOP). A metric that provides a way for a 
commander to describe how well an organization, system, or individual 
must perform a task under a specific set of conditions for a specific 


Mission. 


Mission. The task, together with the purpose, that clearly indicates 
the action to be taken and the reason therefor. 


Mission Essential Task (MET). A task selected by a commander from the 


Universal Naval Task iste (UNTL) deemed essential EO mission 
accomplishment. 


Mission Essential Task List  (METL). A IlVSE “GE tasks “Gonstcerea 


essential to the accomplishment of assigned or anticipated missions. 


Navy Mission Essential Task List (NMETL). A list of Navy tasks 


considered essential to the accomplishment of assigned or anticipated 
missions. 


Quantifiable Variable. Quantifiable variables comprise MOPs. They are 


quantifiable descriptors of task performance given in terms of time, 
ratios, quantities, or some other measurable description. 


ca 


Shute Ves Shag. An UNREP capable cargo ship that shuttles between the 
source of supply and the battle group to replace the actual or planned 
expenditures of the CVBG. Shuttle ships are generally single product, 
e.g., fuel, ordnance, or stores. 


Standard. The minimum acceptable proficiency required in the 
performance of a particular task under a set of conditions. It is 
defined by a commander and consists of measure and criteria. 


Stationmmsnip- An UNREP capable ship that is a member of a carrier 
battle group (CVBG) to replace the actual or planned expenditures of 
the CVBG. Station ships are multi-product, e.g., fuel and ordnance and 
SeOGes. 


Task. A discrete event or action, not specific to a single unit, 
weapon system, or individual, that enables a mission or function to be 
accomplished by individuals and/or organizations. 


Underway Replenishment  (UNREP). A transfer of liquid and/or "oimrd 


cargo between two ships while underway. Two methods of transfer are 
employed: horizontal transfer via connected replenishment rigs and 
vertical replenishment via helicopter. 


Universal Naval Task List (UNTL). A comprehensive hierarchical listing 


of the tasks that can be performed by a naval force, describes the 
variables in the environment that can affect the performance of a given 
task, and provides the measures of performance that can be applied by a 
commander to a set a standard of expected values. 


Vertical Replenishment (VERTREP). A vertical transfer via helicopter 


of liquid and/or solid cargo between two ships while underway. 
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